In this notebook can be found the P4 milestone of the project, a creative extension of the paper Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data by David Muchlinski, David Siroky, Jingrui He and Matthew Kocher.
The research questions we are trying to answer with this notebook are:
Here is the abstract of the content of this notebook, as well as the datasets and methods which will be used.
The takeaways from the original paper are that algorithmic approaches offer a higher predictive power of civil war onset than traditional techniques, an asset used to corroborate some previous causal conclusions, and to question others. We propose to further exploit the derived algorithmic model in order to analyze some temporal aspects of these conflicts. Namely, we will study the evolution of the best predictors across the years. Also, we will tackle the arguably as-important issue of the ending of these conflicts, to gain an insight into the enablers of peace. To do so we will manipulate the data, and leverage the same algorithmic approach to predict ending. Finally, we will use another model, namely artificial neural networks, to study if predictive accuracy can be enhanced further. In the same spirit of the paper, permutation importance will then be used to strengthen or emit new hypotheses on our causal analysis.
The material found in this notebook:
# Import needed modules
import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
import seaborn as sns
# Sklearn modules are used for grid-search, evaluation, ML and dimensionality reduction
from sklearn.metrics import auc
from sklearn.metrics import roc_curve
from sklearn.model_selection import cross_validate
from sklearn.model_selection import KFold
from sklearn.linear_model import LogisticRegression
from sklearn.model_selection import train_test_split
from sklearn.preprocessing import StandardScaler
from sklearn.model_selection import StratifiedKFold
from sklearn.model_selection import RandomizedSearchCV
from sklearn.inspection import permutation_importance
from sklearn.metrics import confusion_matrix, precision_recall_curve, silhouette_score
from sklearn.ensemble import RandomForestClassifier
from sklearn.cluster import OPTICS, DBSCAN, KMeans
from sklearn.decomposition import PCA
from sklearn.manifold import TSNE
# Keras is used for the multilayer perceptron, as it is most versatile than sklearn for ANNs
import tensorflow as tf
import keras
from keras.models import Model, load_model
from keras.layers import Input, Dense
from keras.callbacks import ModelCheckpoint, TensorBoard
from keras import regularizers
from keras.wrappers.scikit_learn import KerasClassifier
# Plotly is used to generate interactive plots
import plotly.express as px
import plotly.graph_objects as go
from plotly.subplots import make_subplots
from plotly.offline import plot
Bad key "text.kerning_factor" on line 4 in
/home/matthieulc/.local/lib/python3.6/site-packages/matplotlib/mpl-data/stylelib/_classic_test_patch.mplstyle.
You probably need to get an updated matplotlibrc file from
http://github.com/matplotlib/matplotlib/blob/master/matplotlibrc.template
or from the matplotlib source distribution
/home/matthieulc/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:516: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint8 = np.dtype([("qint8", np.int8, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:517: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:518: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint16 = np.dtype([("qint16", np.int16, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:519: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:520: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint32 = np.dtype([("qint32", np.int32, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
np_resource = np.dtype([("resource", np.ubyte, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:541: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint8 = np.dtype([("qint8", np.int8, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:542: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:543: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint16 = np.dtype([("qint16", np.int16, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:544: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:545: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint32 = np.dtype([("qint32", np.int32, 1)])
/home/matthieulc/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:550: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
np_resource = np.dtype([("resource", np.ubyte, 1)])
Using TensorFlow backend.
# Variables from Amelia for civil war onset prediction
onset_vars = ['warstds','anoc','ager','autonomy','avgnabo','dem','dlang','drace','drel',
'durable','ef','gdpgrowth','illiteracy','infant','inst','inst3',
'life','lmtnest','milper','nat_war','ncontig','nwstate','oil',
'plural','plurrel','pol4','pol4sq','popdense','relfrac','seceduc',
'second','sxpnew','sxpsq','tnatwar','trade','warhist','xconst',
'lpopns','ln_gdpen','numlang','proxregc','partfree','decade1',
'regd4_alt','etdo4590','geo1','presi','parreg','geo34','year']
# Variables from Amelia for civil war end prediction
warend_vars = ['warend','anoc','ager','autonomy','avgnabo','dem','dlang','drace','drel',
'durable','ef','gdpgrowth','illiteracy','infant','inst','inst3',
'life','lmtnest','milper','nat_war','ncontig','nwstate','oil',
'plural','plurrel','pol4','pol4sq','popdense','relfrac','seceduc',
'second','sxpnew','sxpsq','tnatwar','trade','warhist','xconst',
'lpopns','ln_gdpen','numlang','proxregc','partfree','decade1',
'regd4_alt','etdo4590','geo1','presi','parreg','geo34']
# Global parameters
SEED = 0
DATA_SPLIT = 0.25
CV = 5 # Cross validation folds
SEARCH_ITER = 20 # Iterations for random search (the more the better)
# Create datasets
# Create the dataset for civil war onset
DATA_PATH = 'data/'
pd.set_option('display.max_rows', 500)
pd.set_option('display.max_columns', 500)
# Loading the entire data for selection of the variables of interest for our analysis
df_on = pd.read_csv(DATA_PATH + 'SambnisImp.csv')
# Country codes from authors (corrected by hand)
df_cowcode = pd.read_csv(DATA_PATH + 'COW country codes.csv')
These are functions used throughout the notebook for our analysis. The most important one of which is the pipeline used for the comparison between Random Forest and the Multilayer Perceptron Approach.
def warend_labels(dependent,reduced_dataset,dataset):
"""
This function generates the labels for the civil war end prediction
"""
labels = []
# The reduced_dataset contains only the datapoints where atwards is 1 (country at war that year)
for index,datapoint in reduced_dataset.iterrows():
# A try-except is used since all datapoints do not have a subsequent year
try:
# Compute the index of the subsequent year
next_year_index = dataset[(dataset['cowcode']==datapoint['cowcode'])&(dataset['year']==datapoint['year']+1)].index
next_year = dataset.loc[next_year_index]
# If the subsequent year is not at war anymore, append it
if next_year[dependent].values[0]==0:
reduced_dataset = reduced_dataset.append(next_year)
except:
pass
# The warend label is 1 if the country is not at war anymore after being at war the previous year, 0 if it is at war
reduced_dataset['warend'] = 1-reduced_dataset[dependent]
return reduced_dataset
def train_models(dependent_var,df,search_iter,DATA_SPLIT,CV,SEED,mode='all'):
"""
This function defines the pipeline for analyzing the predictice power and the\
feature importances for both a Random Forest and a Multilayer Perceptron classifier\
for a given dataset and dependent variable
"""
# Split train/test (stratified to conserve the class distribution)
df_train, df_test = train_test_split(df, test_size=DATA_SPLIT, random_state=SEED, stratify=df[dependent_var])
# For test, oversample, otherwise permutation importance is biased towards negative class
# This is done since the permutation_importance function does not provide a class_weight argument
count_0, count_1 = df_test[dependent_var].value_counts()
df_test_0 = df_test[df_test[dependent_var] == 0]
df_test_1 = df_test[df_test[dependent_var] == 1]
df_test_1_over = df_test_1.sample(count_0, replace=True) # Oversample the positive class
df_test = pd.concat([df_test_0, df_test_1_over], axis=0)
# RF dataset
df_train_rf_X = df_train.drop([dependent_var],axis=1)
df_test_rf_X = df_test.drop([dependent_var],axis=1)
# RF scaling (done separately from MLP in case a custom scaling is needed)
scaler = StandardScaler().fit(df_train_rf_X)
df_train_rf_X = scaler.transform(df_train_rf_X)
df_test_rf_X = scaler.transform(df_test_rf_X)
# MLP dataset
df_train_mlp_X = df_train.drop([dependent_var],axis=1)
df_test_mlp_X = df_test.drop([dependent_var],axis=1)
# MLP scaling (done separately from RF in case a custom scaling is needed)
scaler = StandardScaler().fit(df_train_mlp_X)
df_train_mlp_X = scaler.transform(df_train_mlp_X)
df_test_mlp_X = scaler.transform(df_test_mlp_X)
# RF hyperparameter grid (inspired from hands-on tuning)
if mode=='all':
class_weight = [{0: 1, 1: 75}] # Class weights since dataset is imbalanced
n_estimators = [500,1000]
max_features = ['auto','sqrt']
max_depth = [5,10,20]
max_depth.append(None)
min_samples_split = [1, 2, 5, 10]
min_samples_leaf = [1, 2, 5, 10]
bootstrap = [True, False]
scoring='balanced_accuracy'
rf_grid_params = {'class_weight': class_weight,
'n_estimators': n_estimators,
'max_features': max_features,
'max_depth': max_depth,
'min_samples_split': min_samples_split,
'min_samples_leaf': min_samples_leaf,
'bootstrap': bootstrap}
elif mode=='bins':
class_weight = [{0: 1, 1: 75}] # Class weights since dataset is imbalanced
n_estimators = [750,1000,1250]
max_features = ['auto','log2']
max_depth = [3,5,7]
min_samples_split = [5, 10]
min_samples_leaf = [2, 5, 10]
bootstrap = [True, False]
scoring = 'balanced_accuracy'
rf_grid_params = {'class_weight': class_weight,
'n_estimators': n_estimators,
'max_features': max_features,
'max_depth': max_depth,
'min_samples_split': min_samples_split,
'min_samples_leaf': min_samples_leaf,
'bootstrap': bootstrap}
# RF random search
rf_grid = RandomizedSearchCV(estimator = RandomForestClassifier(), param_distributions = rf_grid_params,
scoring=scoring, n_iter = search_iter, cv = CV, verbose=2,random_state=SEED, n_jobs = -1)
rf_grid.fit(df_train_rf_X, df_train[dependent_var])
rf = rf_grid.best_estimator_
res_rf = rf_grid.cv_results_
# MLP base (define the base structure of the MLP)
def create_mlp(input_dim,optimizer='adam',dropout_rate=0.0,lr=1e-3,epochs=100,nlayer1=16,nlayer2=8):
model = keras.models.Sequential()
model.add(Dense(nlayer1, input_dim=input_dim, activation='relu'))
model.add(keras.layers.Dropout(dropout_rate))
model.add(Dense(nlayer2, activation='relu'))
model.add(Dense(1, activation='sigmoid'))
if optimizer=='Adam':
model.compile(loss='binary_crossentropy',
optimizer=keras.optimizers.Adam(learning_rate=lr),
metrics=['accuracy'])
elif optimizer=='RMSprop':
model.compile(loss='binary_crossentropy',
optimizer=keras.optimizers.RMSprop(learning_rate=lr),
metrics=['accuracy'])
return model
# MLP model
mlp_model = KerasClassifier(build_fn=create_mlp, verbose=1)
# MLP hyperparameter grid (inspired from hands-on tuning)
if mode=='all':
class_weights = {0:1,1:75} # Class weights since dataset is imbalanced
batch_size = [df_train_mlp_X.shape[0]] # Full batch
optimizer = ['RMSprop', 'Adam']
dropout_rate = [0.0,0.5]
nlayer1 = [64,32]
nlayer2 = [32,16]
lr = [1e-2,1e-3,1e-4]
epochs = [50,120]
scoring = 'balanced_accuracy'
input_dim = [df_train_mlp_X.shape[1]]
mlp_grid_params = {'batch_size':batch_size,
'optimizer':optimizer,
'dropout_rate':dropout_rate,
'nlayer1':nlayer1,
'nlayer2':nlayer2,
'lr':lr,
'epochs':epochs,
'input_dim':input_dim}
elif mode=='bins':
class_weights = {0:1,1:75} # Class weights since dataset is imbalanced
batch_size = [df_train_mlp_X.shape[0]] # Full batch
optimizer = ['RMSprop', 'Adam']
dropout_rate = [0.3,0.5]
nlayer1 = [64,32]
nlayer2 = [16,8]
lr = [5e-3,1e-3,5e-4]
epochs = [50,120]
scoring = 'balanced_accuracy'
input_dim = [df_train_mlp_X.shape[1]]
mlp_grid_params = {'batch_size':batch_size,
'optimizer':optimizer,
'dropout_rate':dropout_rate,
'nlayer1':nlayer1,
'nlayer2':nlayer2,
'lr':lr,
'epochs':epochs,
'input_dim':input_dim}
# MLP random search
mlp_grid = RandomizedSearchCV(estimator = mlp_model, param_distributions = mlp_grid_params,
scoring=scoring, n_iter = search_iter, cv = CV, verbose=2,random_state=SEED, n_jobs = -1)
mlp_grid.fit(df_train_mlp_X, df_train[dependent_var], class_weight=class_weights)
mlp = mlp_grid.best_estimator_
res_mlp = mlp_grid.cv_results_
# RF predictions (can be used for ROC curves)
rf_predict = rf.predict_proba(df_test_rf_X)[:, 1]
df_rf_predict = pd.DataFrame({'Predicted': rf_predict,'Label': df_test[dependent_var]})
df_rf_predict = df_rf_predict.reset_index()
# MLP predictions (can be used for ROC curves)
mlp_predict = mlp.predict_proba(df_test_mlp_X)[:, 1]
df_mlp_predict = pd.DataFrame({'Predicted': mlp_predict,'Label': df_test[dependent_var]})
df_mlp_predict = df_mlp_predict.reset_index()
# RF importances
importance_rf = permutation_importance(rf, df_test_rf_X, df_test[dependent_var],
n_repeats=10,
random_state=SEED).importances_mean
importances_rf = pd.DataFrame({"Scores":importance_rf,"Names": df_test.drop(dependent_var,axis=1).columns})
importances_rf["Model"]="Random Forest"
# MLP importances
importance_mlp = permutation_importance(mlp, df_test_mlp_X, df_test[dependent_var],
n_repeats=10,
random_state=SEED).importances_mean
importances_mlp = pd.DataFrame({"Scores":importance_mlp,"Names": df_test.drop(dependent_var,axis=1).columns})
importances_mlp["Model"]="Multilayer Perceptron"
# Importances (concatenate all)
importances = importances_rf.append(importances_mlp)
return rf,mlp,df_rf_predict,df_mlp_predict,importances
def CI(data,nbr_draws):
"""
Function for computing bootstrapped confidence intervals at the 90% level
"""
value = np.zeros(nbr_draws) # Array for the computations
data = np.array(data)
for n in range(nbr_draws):
# Pick random indices in the data (drawing with replacement)
indices = np.random.randint(0, len(data), len(data))
data_tmp = data[indices]
# Calculate the mean
value[n] = np.mean(data_tmp)
return pd.Series([np.nanpercentile(value, 5), np.nanpercentile(value, 95)],
index= ['CI lower bound', 'CI higher bound']) # Gather the percentiles
def around(serie,year):
a = []
for item in serie:
if item in range(year-5,year+11):
a.append(True)
else:
a.append(False)
return a
For plotting the world maps, we extend the dataset with the alpha3 country codes, and the country names.
# Add alpha3 country code used for plotly
df_cowcode.rename(columns={'CCode':'cowcode'}, inplace=True)
stateabb_mapping = dict(df_cowcode[['cowcode', 'StateAbb']].values) # Mapping from cowcode to the alpha3 code
statename_mapping = dict(df_cowcode[['cowcode', 'StateNme']].values) # Mapping from cowcode to state name
df_on['cowalpha'] = df_on.cowcode.map(stateabb_mapping) # Alpha3 column
df_on['statename'] = df_on.cowcode.map(statename_mapping) # State name column
df_on.head()
| Unnamed: 0 | atwards | X | id | cid | cowcode | year | warstds | ptime | yrint | autonomy | rf | popdense | auto98 | dem98 | pol98 | army85 | milgnp92 | milper | milex | trade | logpop | ienergy | ienercap | lnienc | gdpmkt | gdpcap | irgdp | decade | regy | neth_war | nmgdp | nmie | nmdie | autch98 | demch98 | polch98 | moslem | christ | jewish | eastorth | hindu | buddhist | sinic | indi_ani | atheist | other | rgdpch | gdppp | rgdpa_ | lngdp_ | rgdppca | expgdp | primexp | sxpold | sxpnew | sxpnew100 | agexp | fuelexp | manuexp | nmp4 | nmp4l | nmdp4l | nmp4m | nmp4ml | nmdp4ml | p4mchg | period5 | ptwds | fedpol3 | semipol3 | centpol3 | autdpi | munidpi | statedpi | authdpi | stcondpi | primeg | seceduc | pri | sec | secm | educyrs | primeduc | higheduc | xrreg | xrcomp | xropen | xconst | parreg | parcomp | polcomp | partfree | major | presi | incumb | inst | lmtnest | oil | anoc | dem | elfo2 | ethfrac2 | warhist | warhist2cow | wwgdpcap | mirps | sip2 | gdpgrowth | avgnabo | part | illiteracy | pregch | warstns | warstnsb | atwarns | yrbeg | mobeg | yrend | moend | ehet | drace | dlang | drel | popns | pgrowth | popdensi | illit | illitm | infant | life | energy | irst | elfo | etdo4590 | auto4 | dem4 | pol4 | pol4m | nmpol4m | nmpol4m2 | geo | gdpen | gdpgro | gdpgro3 | mtnest | ncontig | ethfrac | ef | plural | second | numlang | relfrac | plurrel | muslim | nwstate | instab | anocl1 | ssafrica | reg | ager | reginst | durable | exrec | exconst | exrecm | exconstm | iexrec | iexcon | polity2 | durable2 | xrreg2 | xrcomp2 | xropen2 | xconst2 | parreg2 | exrec2 | exconst2 | polcomp2 | poldiff | inst2 | inst3 | fuel | ifuel | oil2 | ld_warstns | ld_warstnsb | ld_instab | ld_inst2 | ld_inst3 | ln_gdpen | lpopns | coldwar | anoc2 | lnmtn | warnsl1 | auto4l1 | pol4l1 | dem4l1 | pol4ml1 | regd4ml1 | coldl1 | lpopnsl1 | gdpl1 | grol1 | oil2l1 | illitl1 | infal1 | pdensl1 | ef1 | ethfrl1 | nwstl1 | mtnl1 | lnmtnl1 | etdol1 | musl1 | regl1 | agerl1 | rinstl1 | anoc2l1 | durabl1 | durab2l1 | iexrecl1 | iexconl1 | pol2l1 | poll1 | poldiffl1 | inst2l1 | inst3l1 | gdpl1m | inst3l1m | anoc2l1m | oil2l1m | lpopns1m | musl1m | grol1m | ptwns | spl1wns | spl2wns | spl3wns | ptwbns | spl1wbns | spl2wbns | spl3wbns | cowcode2 | primkey2 | filter | filter1960 | geo1 | geo2 | geo34 | geo57 | geo69 | geo8 | region | regionyear | ln_gdpen_region | regd4 | regd4_alt | regd4m | nmdp4 | nmdp4_alt | nmdp4m | nat_war | tnatwar | nmdgdp | indepyear | ef2 | mirps0 | mirps1 | mirps2 | mirps3 | sxpsq | sxpsq100 | pol4sq | ln_popns | decade1 | decade2 | decade3 | decade4 | independ | tip | anocracy | proxregc | sxpnew.2 | sxpsq.2 | cowalpha | statename | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 1 | 0 | 1 | 1.0 | 1 | 700 | 1945 | 0 | 12 | 0 | 0.005151 | 35.481968 | 118.554791 | 3.963861 | 3.975114 | 0.011254 | 129472.9042 | 3.364459 | 121.087366 | 2026920.351 | 72.881375 | 15.396132 | 65.537419 | 0.000005 | -13.589183 | 6.913641e+10 | 3576.215319 | 4546.011265 | 3 | 4582.635847 | 0 | 4508.131692 | 133.911444 | 103.999685 | 0 | 0 | 0 | 1 | 0 | 0.110981 | 0.084817 | 0.125454 | 0.111091 | 0.048737 | 0.267661 | 0.100296 | 0.474928 | 4396.451257 | 5756.961919 | 4383.157345 | 7.877439 | 4708.717563 | 33.592410 | 4516829.842 | 0.178227 | 0.158275 | 15.827521 | 8.510845 | 15.387903 | 32.746177 | -5.00 | -5.00 | -5.0 | -3.333333 | -3.333333 | -1.0 | 0.051008 | 1 | 0.0 | 0.132263 | 0.058441 | 1 | 0.049971 | 1.418681 | 0.844470 | 0.497189 | 0.444833 | 87.710445 | 43.770298 | 87.931355 | 43.619826 | 45.641668 | 5.045348 | 3.686457 | 0.149502 | 3.0 | 1.0 | 1.0 | 3.995912 | 3.835219 | 2.733729 | 5.059323 | 0 | 0 | 0 | 0 | 1 | 4.198705 | 0 | 0 | 0 | 2212.227998 | 0.433334 | 0 | 0.0 | 7.649929 | 1.916776 | 0.46176 | 0.022562 | 0.432955 | 2.43732 | 34.020639 | 23.461451 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 90.0 | 0.0 | 70.0 | 20.0 | 9763000.0 | 0.016712 | 118.554791 | 35.298431 | 29.837203 | 68.655361 | 61.348104 | 40013.22663 | 3342.282218 | 66.0 | 1.0 | 3.925812 | 3.995929 | 0.070117 | 0.068564 | -3.33 | -3.33 | 5.0 | 3.975382 | 0.026227 | 0.053519 | 65.600014 | 0.0 | 0.658281 | 0.750797 | 0.38 | 0.253 | 8.0 | 0.2718 | 84.0 | 99.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.581817 | 34.461765 | 0 | 20.909713 | 5.292369 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | -10.0 | 20.969866 | 3.0 | 1.0 | 1.0 | 1.0 | 4.0 | 1.0 | 1.0 | 1.0 | 0.99758 | 0.109709 | 0.120897 | 15.888645 | 15.729478 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.851709 | 16.094110 | 1 | 0.0 | 4.183576 | 0.010736 | 2.010071 | 0.070117 | 2.078635 | 0.068564 | 0.221852 | 0.797062 | 15.481758 | 3.996225 | 0.026059 | 0.129262 | 35.228102 | 68.655361 | 118.417020 | 0.440660 | 0.366792 | 0.026656 | 17.280216 | 2.313682 | 0.455522 | 23.813461 | 0.581817 | 34.461765 | 0 | 0.194079 | 20.909713 | 20.899415 | 5.287654 | 3.981327 | -0.212857 | -0.212857 | 1.000386 | 0.112198 | 0.124305 | 3.948095 | 0.124709 | 0.0 | 0.0 | 16.094110 | 99.0 | 0.026204 | 0.0 | 0.000000 | 0.000000 | 0.000000 | 0.0 | 0.000000 | 0.000000 | 0.000000 | 700 | 7001945 | 7001945.0 | 4277397.373 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 4.0 | 41945.0 | 0.665679 | -0.525089 | -0.413956 | -0.301959 | -0.484437 | -0.475189 | -0.414541 | 0 | 0.443259 | -0.438089 | 1929.0 | 0.563696 | 0.143794 | 0.16935 | 0.313143 | 0.373714 | 0.052989 | 5.298909 | 61.493014 | 16.094110 | 0 | 0 | 0 | 0 | 1 | 17.0 | 0 | 0.143299 | 0.094095 | 0.094095 | AFG | Afghanistan |
| 1 | 2 | 0 | 2 | 1.0 | 1 | 700 | 1946 | 0 | 24 | 1 | 0.000000 | 35.419919 | 117.756342 | 3.964334 | 3.951079 | -0.013255 | 129413.0225 | 3.395093 | 121.885359 | 2023556.026 | 72.900089 | 15.410615 | 64.194387 | 0.000005 | -13.582179 | 6.727678e+10 | 3543.940322 | 4521.305349 | 3 | 4564.097301 | 0 | 4491.340308 | 133.324455 | 103.225502 | 0 | 0 | 0 | 1 | 0 | 0.110148 | 0.083145 | 0.124768 | 0.111214 | 0.049091 | 0.270664 | 0.098340 | 0.471436 | 4368.951517 | 5682.633327 | 4349.608929 | 7.869915 | 4704.910936 | 33.561559 | 4501525.634 | 0.177838 | 0.158321 | 15.832111 | 8.478997 | 15.594645 | 32.687070 | -5.00 | -5.00 | -5.0 | -5.000000 | -5.000000 | -5.0 | 0.053837 | 1 | 1.0 | 0.000000 | 0.000000 | 1 | 0.051908 | 1.407096 | 0.835712 | 0.491071 | 0.444326 | 87.821747 | 43.588363 | 88.007471 | 43.528630 | 45.557555 | 5.026119 | 3.673518 | 0.148923 | 3.0 | 1.0 | 1.0 | 1.000000 | 4.000000 | 1.000000 | 1.000000 | 0 | 0 | 0 | 0 | 0 | 4.198705 | 0 | 0 | 0 | 2219.468491 | 0.433334 | 0 | 0.0 | 7.636630 | 2.000000 | 0.00000 | 0.022447 | 0.045052 | 1.00000 | 34.129908 | 23.267523 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 90.0 | 0.0 | 70.0 | 20.0 | 9982000.0 | 0.022432 | 117.756342 | 35.417527 | 29.893792 | 68.918002 | 61.297733 | 39970.07046 | 3360.773320 | 66.0 | 1.0 | 10.000000 | 0.000000 | -10.000000 | -10.000000 | -5.00 | -5.00 | 5.0 | 0.194000 | 0.026177 | 0.053511 | 65.600014 | 0.0 | 0.658281 | 0.750797 | 0.38 | 0.253 | 8.0 | 0.2718 | 84.0 | 99.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.585308 | 34.346348 | 0 | 0.000000 | 1.000000 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | -10.0 | 20.904897 | 3.0 | 1.0 | 1.0 | 1.0 | 4.0 | 1.0 | 1.0 | 1.0 | 0.00000 | 0.000000 | 0.000000 | 16.068722 | 15.919773 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | -1.639897 | 16.116295 | 1 | 0.0 | 4.183576 | 0.000000 | 10.000000 | -10.000000 | 0.000000 | -10.000000 | -3.500000 | 1.000000 | 16.094110 | 3.955104 | 0.026079 | 0.000000 | 35.368663 | 68.918002 | 117.795802 | 0.750797 | 0.658281 | 0.000000 | 65.600014 | 4.183576 | 1.000000 | 99.000000 | 0.585308 | 34.346348 | 0 | 0.000000 | 0.000000 | 20.772269 | 1.000000 | 1.000000 | -10.000000 | -10.000000 | 0.998158 | 0.112882 | 0.124967 | 0.194000 | 0.000000 | 0.0 | 0.0 | 16.094110 | 99.0 | 0.026199 | 1.0 | -0.888889 | -0.703704 | -0.462963 | 1.0 | -0.888889 | -0.722222 | -0.481481 | 700 | 7001946 | 7001946.0 | 4290808.867 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 4.0 | 41946.0 | -0.234270 | -3.000000 | -3.000000 | -1.500000 | -5.000000 | -5.000000 | -1.000000 | 1 | 1.000000 | -0.118223 | 1929.0 | 0.563696 | 0.000000 | 0.00000 | 1.000000 | 0.000000 | 0.052663 | 5.266345 | 100.000000 | 16.116295 | 0 | 0 | 0 | 0 | 1 | 18.0 | 0 | 1.000000 | 0.094547 | 0.094547 | AFG | Afghanistan |
| 2 | 3 | 0 | 3 | 1.0 | 1 | 700 | 1947 | 0 | 36 | 2 | 0.000000 | 35.407984 | 118.280656 | 3.973155 | 3.940862 | -0.032294 | 130431.0145 | 3.396670 | 122.780608 | 2021187.986 | 72.962880 | 15.413207 | 64.456853 | 0.000005 | -13.582793 | 6.752931e+10 | 3545.351645 | 4517.727622 | 3 | 4559.854388 | 0 | 4484.267686 | 132.169989 | 102.165792 | 0 | 0 | 0 | 1 | 0 | 0.111173 | 0.083046 | 0.124837 | 0.111591 | 0.049345 | 0.270870 | 0.098164 | 0.469912 | 4364.105509 | 5678.756379 | 4347.804961 | 7.868255 | 4699.105175 | 33.577128 | 4497744.498 | 0.177683 | 0.158425 | 15.842452 | 8.481015 | 15.601810 | 32.655442 | -4.75 | -4.75 | -4.5 | -4.750000 | -4.750000 | -4.5 | 0.000000 | 1 | 2.0 | 0.000000 | 0.000000 | 1 | 0.052104 | 1.408160 | 0.835757 | 0.492666 | 0.443512 | 87.792349 | 43.538181 | 87.972309 | 43.492354 | 45.523063 | 5.021100 | 3.669662 | 0.148718 | 3.0 | 1.0 | 1.0 | 1.000000 | 4.000000 | 1.000000 | 1.000000 | 0 | 0 | 0 | 0 | 0 | 4.198705 | 0 | 0 | 0 | 2219.825536 | 0.433334 | 0 | 0.0 | 7.634660 | 2.000000 | 0.00000 | 0.022372 | 0.030034 | 1.00000 | 34.183272 | 23.260889 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 90.0 | 0.0 | 70.0 | 20.0 | 10204000.0 | 0.022240 | 118.280656 | 35.465369 | 29.925167 | 69.017545 | 61.285176 | 40071.20084 | 3360.474580 | 66.0 | 1.0 | 10.000000 | 0.000000 | -10.000000 | -10.000000 | -4.75 | -4.75 | 5.0 | 0.196000 | 0.010309 | 0.053494 | 65.600014 | 0.0 | 0.658281 | 0.750797 | 0.38 | 0.253 | 8.0 | 0.2718 | 84.0 | 99.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.000000 | 77.000000 | 0 | 0.000000 | 1.000000 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | -10.0 | 20.919758 | 3.0 | 1.0 | 1.0 | 1.0 | 4.0 | 1.0 | 1.0 | 1.0 | 0.00000 | 0.000000 | 0.000000 | 16.073523 | 15.915548 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | -1.629641 | 16.138290 | 1 | 0.0 | 4.183576 | 0.000000 | 10.000000 | -10.000000 | 0.000000 | -10.000000 | -3.250000 | 1.000000 | 16.116295 | 0.194000 | 0.026068 | 0.000000 | 35.415530 | 69.017545 | 118.273045 | 0.750797 | 0.658281 | 0.000000 | 65.600014 | 4.183576 | 1.000000 | 99.000000 | 1.000000 | 77.000000 | 0 | 0.000000 | 0.000000 | 20.773387 | 1.000000 | 1.000000 | -10.000000 | -10.000000 | 0.000000 | 0.000000 | 0.000000 | 0.194000 | 0.000000 | 0.0 | 0.0 | 16.116295 | 99.0 | 0.010309 | 2.0 | -7.111111 | -5.629630 | -3.703704 | 2.0 | -7.111111 | -5.777778 | -3.851852 | 700 | 7001947 | 7001947.0 | 4293719.594 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 4.0 | 41947.0 | -0.191889 | -3.000000 | -3.000000 | -1.500000 | -5.000000 | -5.000000 | -5.000000 | 1 | 2.000000 | -0.005597 | 1929.0 | 0.563696 | 0.000000 | 0.00000 | 1.000000 | 0.000000 | 0.052891 | 5.289146 | 100.000000 | 16.138290 | 0 | 0 | 0 | 0 | 1 | 19.0 | 0 | 1.000000 | 0.095567 | 0.095567 | AFG | Afghanistan |
| 3 | 4 | 0 | 4 | 1.0 | 1 | 700 | 1948 | 0 | 48 | 3 | 0.000000 | 35.429719 | 118.325869 | 3.982209 | 3.929385 | -0.052824 | 126781.6866 | 3.398607 | 118.256427 | 1937812.163 | 73.102449 | 15.402485 | 62.769678 | 0.000005 | -13.583109 | 6.595735e+10 | 3538.992284 | 4505.615991 | 3 | 4552.189750 | 0 | 4474.082672 | 132.879524 | 103.044307 | 0 | 0 | 0 | 1 | 0 | 0.109695 | 0.082307 | 0.125075 | 0.110781 | 0.048779 | 0.272840 | 0.097850 | 0.469618 | 4350.701094 | 5669.945640 | 4342.333470 | 7.866235 | 4685.678167 | 33.625990 | 4493250.139 | 0.178191 | 0.159006 | 15.900641 | 8.451628 | 15.739340 | 32.502945 | -3.25 | -3.25 | -3.0 | -3.250000 | -3.250000 | -3.0 | 0.000000 | 1 | 3.0 | 0.000000 | 0.000000 | 1 | 0.050322 | 1.398728 | 0.829927 | 0.486587 | 0.441407 | 87.709954 | 43.490005 | 87.885682 | 43.413107 | 45.446892 | 5.014381 | 3.664933 | 0.148584 | 3.0 | 1.0 | 1.0 | 1.000000 | 4.000000 | 1.000000 | 1.000000 | 0 | 0 | 0 | 0 | 0 | 4.198705 | 0 | 0 | 0 | 2225.284783 | 0.433334 | 0 | 0.0 | 7.631662 | 2.000000 | 0.00000 | 0.022239 | 0.022526 | 1.00000 | 34.234445 | 23.234586 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 90.0 | 0.0 | 70.0 | 20.0 | 11439000.0 | 0.121031 | 118.325869 | 35.581125 | 30.024060 | 69.126788 | 61.252967 | 38787.42822 | 3260.759840 | 66.0 | 1.0 | 10.000000 | 0.000000 | -10.000000 | -10.000000 | -3.25 | -3.25 | 5.0 | 0.194000 | -0.010204 | 0.000000 | 65.600014 | 0.0 | 0.658281 | 0.750797 | 0.38 | 0.253 | 8.0 | 0.2718 | 84.0 | 99.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.000000 | 78.000000 | 0 | 0.000000 | 1.000000 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | -10.0 | 20.893597 | 3.0 | 1.0 | 1.0 | 1.0 | 4.0 | 1.0 | 1.0 | 1.0 | 0.00000 | 0.000000 | 0.000000 | 16.196720 | 16.010910 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | -1.639897 | 16.252539 | 1 | 0.0 | 4.183576 | 0.000000 | 10.000000 | -10.000000 | 0.000000 | -10.000000 | -3.556000 | 1.000000 | 16.138290 | 0.196000 | 0.010309 | 0.000000 | 35.531501 | 69.126788 | 118.335115 | 0.750797 | 0.658281 | 0.000000 | 65.600014 | 4.183576 | 1.000000 | 99.000000 | 1.000000 | 78.000000 | 0 | 0.000000 | 0.000000 | 20.746572 | 1.000000 | 1.000000 | -10.000000 | -10.000000 | 0.000000 | 0.000000 | 0.000000 | 0.196000 | 0.000000 | 0.0 | 0.0 | 16.138290 | 99.0 | 0.010309 | 3.0 | -24.000000 | -19.000000 | -12.500000 | 3.0 | -24.000000 | -19.500000 | -13.000000 | 700 | 7001948 | 7001948.0 | 4297356.141 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 4.0 | 41948.0 | -0.273971 | -3.500000 | -3.500000 | -3.000000 | -4.500000 | -4.500000 | -4.500000 | 1 | 2.000000 | -0.016321 | 1929.0 | 0.563696 | 0.000000 | 0.00000 | 1.000000 | 0.000000 | 0.052902 | 5.290242 | 100.000000 | 16.252539 | 0 | 0 | 0 | 0 | 1 | 20.0 | 0 | 1.000000 | 0.101303 | 0.101303 | AFG | Afghanistan |
| 4 | 5 | 0 | 5 | 1.0 | 1 | 700 | 1949 | 0 | 60 | 4 | 0.000000 | 35.400103 | 118.312296 | 3.973679 | 3.949860 | -0.023818 | 130979.2470 | 3.383485 | 122.245074 | 2022832.330 | 72.850389 | 15.414033 | 64.858887 | 0.000005 | -13.586362 | 6.816844e+10 | 3554.029279 | 4528.103915 | 3 | 4570.361715 | 0 | 4497.299503 | 133.651072 | 103.487874 | 0 | 0 | 0 | 1 | 0 | 0.111176 | 0.083263 | 0.124562 | 0.111843 | 0.049416 | 0.269917 | 0.098638 | 0.471806 | 4372.513428 | 5698.153736 | 4358.965216 | 7.870948 | 4700.808948 | 33.538608 | 4509679.050 | 0.177463 | 0.158074 | 15.807353 | 8.500172 | 15.525010 | 32.741521 | -3.50 | -3.50 | -4.5 | -3.500000 | -3.500000 | -4.5 | 0.000000 | 1 | 4.0 | 0.000000 | 0.000000 | 1 | 0.051838 | 1.411389 | 0.839208 | 0.496489 | 0.445398 | 87.777774 | 43.602238 | 87.947331 | 43.538125 | 45.577940 | 5.024398 | 3.671074 | 0.148781 | 3.0 | 1.0 | 1.0 | 1.000000 | 4.000000 | 1.000000 | 1.000000 | 0 | 0 | 0 | 0 | 0 | 4.198705 | 0 | 0 | 0 | 2216.878723 | 0.433334 | 0 | 0.0 | 7.639611 | 2.000000 | 0.00000 | 0.022462 | 0.022526 | 1.00000 | 34.164099 | 23.313890 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 90.0 | 0.0 | 70.0 | 20.0 | 11648000.0 | 0.018271 | 118.312296 | 35.438494 | 29.924057 | 68.960291 | 61.301547 | 40188.97750 | 3363.430404 | 66.0 | 1.0 | 10.000000 | 0.000000 | -10.000000 | -10.000000 | -3.50 | -3.50 | 5.0 | 0.247000 | 0.273196 | 0.260204 | 65.600014 | 0.0 | 0.658281 | 0.750797 | 0.38 | 0.253 | 8.0 | 0.2718 | 84.0 | 99.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.000000 | 79.000000 | 0 | 0.000000 | 1.000000 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | -10.0 | 20.960157 | 3.0 | 1.0 | 1.0 | 1.0 | 4.0 | 1.0 | 1.0 | 1.0 | 0.00000 | 0.000000 | 0.000000 | 16.014538 | 15.841205 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | -1.398367 | 16.270645 | 1 | 0.0 | 4.183576 | 0.000000 | 10.000000 | -10.000000 | 0.000000 | -10.000000 | -1.083000 | 1.000000 | 16.252539 | 0.194000 | -0.010204 | 0.000000 | 35.373708 | 68.960291 | 118.245595 | 0.750797 | 0.658281 | 0.000000 | 65.600014 | 4.183576 | 1.000000 | 99.000000 | 1.000000 | 79.000000 | 0 | 0.000000 | 0.000000 | 20.807190 | 1.000000 | 1.000000 | -10.000000 | -10.000000 | 0.000000 | 0.000000 | 0.000000 | 0.194000 | 0.000000 | 0.0 | 0.0 | 16.252539 | 99.0 | -0.010204 | 4.0 | -56.888889 | -45.037037 | -29.629629 | 4.0 | -56.888889 | -46.222221 | -30.814816 | 700 | 7001949 | 7001949.0 | 4283813.301 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 4.0 | 41949.0 | -0.367687 | 2.000000 | 2.000000 | 1.000000 | -3.000000 | -3.000000 | -3.000000 | 1 | 2.000000 | -0.310458 | 1929.0 | 0.563696 | 0.000000 | 0.00000 | 1.000000 | 0.000000 | 0.052706 | 5.270616 | 100.000000 | 16.270645 | 0 | 0 | 0 | 0 | 1 | 21.0 | 0 | 1.000000 | 0.092107 | 0.092107 | AFG | Afghanistan |
For our entire analysis, we will use the features selected in the Amelia dataset. These features were selected in order to make some analysis on the causal aspect of civil war. Therefore, we decided to select the same features, since we are interested in the civil war onsets causes and civil war end causes. However since this dataset has some missing values and is a bit more dirty than the dataset from Sambanis, we will use the latter, but with the features of the Amelia dataset.
For the prediction of civil war onset, we will use the variable warstds, which we add to the dataset.
df_onset = df_on[onset_vars].copy()
df_onset.head()
| warstds | anoc | ager | autonomy | avgnabo | dem | dlang | drace | drel | durable | ef | gdpgrowth | illiteracy | infant | inst | inst3 | life | lmtnest | milper | nat_war | ncontig | nwstate | oil | plural | plurrel | pol4 | pol4sq | popdense | relfrac | seceduc | second | sxpnew | sxpsq | tnatwar | trade | warhist | xconst | lpopns | ln_gdpen | numlang | proxregc | partfree | decade1 | regd4_alt | etdo4590 | geo1 | presi | parreg | geo34 | year | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 0 | 34.461765 | 0.005151 | 0.432955 | 0 | 70.0 | 0.0 | 20.0 | 20.909713 | 0.750797 | 0.022562 | 34.020639 | 68.655361 | 1 | 0.120897 | 61.348104 | 4.198705 | 121.087366 | 0 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | 0.070117 | 61.493014 | 118.554791 | 0.2718 | 43.770298 | 0.253 | 0.158275 | 0.052989 | 0.443259 | 72.881375 | 0 | 3.995912 | 16.094110 | 0.851709 | 8.0 | 0.143299 | 0 | 0 | -0.413956 | 1.0 | 0.0 | 0 | 3.835219 | 0.0 | 1945 |
| 1 | 0 | 0 | 34.346348 | 0.000000 | 0.045052 | 0 | 70.0 | 0.0 | 20.0 | 0.000000 | 0.750797 | 0.022447 | 34.129908 | 68.918002 | 0 | 0.000000 | 61.297733 | 4.198705 | 121.885359 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 117.756342 | 0.2718 | 43.588363 | 0.253 | 0.158321 | 0.052663 | 1.000000 | 72.900089 | 0 | 1.000000 | 16.116295 | -1.639897 | 8.0 | 1.000000 | 0 | 0 | -3.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1946 |
| 2 | 0 | 0 | 77.000000 | 0.000000 | 0.030034 | 0 | 70.0 | 0.0 | 20.0 | 0.000000 | 0.750797 | 0.022372 | 34.183272 | 69.017545 | 0 | 0.000000 | 61.285176 | 4.198705 | 122.780608 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 118.280656 | 0.2718 | 43.538181 | 0.253 | 0.158425 | 0.052891 | 2.000000 | 72.962880 | 0 | 1.000000 | 16.138290 | -1.629641 | 8.0 | 1.000000 | 0 | 0 | -3.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1947 |
| 3 | 0 | 0 | 78.000000 | 0.000000 | 0.022526 | 0 | 70.0 | 0.0 | 20.0 | 0.000000 | 0.750797 | 0.022239 | 34.234445 | 69.126788 | 0 | 0.000000 | 61.252967 | 4.198705 | 118.256427 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 118.325869 | 0.2718 | 43.490005 | 0.253 | 0.159006 | 0.052902 | 2.000000 | 73.102449 | 0 | 1.000000 | 16.252539 | -1.639897 | 8.0 | 1.000000 | 0 | 0 | -3.500000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1948 |
| 4 | 0 | 0 | 79.000000 | 0.000000 | 0.022526 | 0 | 70.0 | 0.0 | 20.0 | 0.000000 | 0.750797 | 0.022462 | 34.164099 | 68.960291 | 0 | 0.000000 | 61.301547 | 4.198705 | 122.245074 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 118.312296 | 0.2718 | 43.602238 | 0.253 | 0.158074 | 0.052706 | 2.000000 | 72.850389 | 0 | 1.000000 | 16.270645 | -1.398367 | 8.0 | 1.000000 | 0 | 0 | 2.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1949 |
In this first part, we will have a look at the dataset, and verify that the data seems valid. We will also look at the features and discard some non-interesting features.
df_onset.head()
| warstds | anoc | ager | autonomy | avgnabo | dem | dlang | drace | drel | durable | ef | gdpgrowth | illiteracy | infant | inst | inst3 | life | lmtnest | milper | nat_war | ncontig | nwstate | oil | plural | plurrel | pol4 | pol4sq | popdense | relfrac | seceduc | second | sxpnew | sxpsq | tnatwar | trade | warhist | xconst | lpopns | ln_gdpen | numlang | proxregc | partfree | decade1 | regd4_alt | etdo4590 | geo1 | presi | parreg | geo34 | year | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 0 | 34.461765 | 0.005151 | 0.432955 | 0 | 70.0 | 0.0 | 20.0 | 20.909713 | 0.750797 | 0.022562 | 34.020639 | 68.655361 | 1 | 0.120897 | 61.348104 | 4.198705 | 121.087366 | 0 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | 0.070117 | 61.493014 | 118.554791 | 0.2718 | 43.770298 | 0.253 | 0.158275 | 0.052989 | 0.443259 | 72.881375 | 0 | 3.995912 | 16.094110 | 0.851709 | 8.0 | 0.143299 | 0 | 0 | -0.413956 | 1.0 | 0.0 | 0 | 3.835219 | 0.0 | 1945 |
| 1 | 0 | 0 | 34.346348 | 0.000000 | 0.045052 | 0 | 70.0 | 0.0 | 20.0 | 0.000000 | 0.750797 | 0.022447 | 34.129908 | 68.918002 | 0 | 0.000000 | 61.297733 | 4.198705 | 121.885359 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 117.756342 | 0.2718 | 43.588363 | 0.253 | 0.158321 | 0.052663 | 1.000000 | 72.900089 | 0 | 1.000000 | 16.116295 | -1.639897 | 8.0 | 1.000000 | 0 | 0 | -3.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1946 |
| 2 | 0 | 0 | 77.000000 | 0.000000 | 0.030034 | 0 | 70.0 | 0.0 | 20.0 | 0.000000 | 0.750797 | 0.022372 | 34.183272 | 69.017545 | 0 | 0.000000 | 61.285176 | 4.198705 | 122.780608 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 118.280656 | 0.2718 | 43.538181 | 0.253 | 0.158425 | 0.052891 | 2.000000 | 72.962880 | 0 | 1.000000 | 16.138290 | -1.629641 | 8.0 | 1.000000 | 0 | 0 | -3.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1947 |
| 3 | 0 | 0 | 78.000000 | 0.000000 | 0.022526 | 0 | 70.0 | 0.0 | 20.0 | 0.000000 | 0.750797 | 0.022239 | 34.234445 | 69.126788 | 0 | 0.000000 | 61.252967 | 4.198705 | 118.256427 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 118.325869 | 0.2718 | 43.490005 | 0.253 | 0.159006 | 0.052902 | 2.000000 | 73.102449 | 0 | 1.000000 | 16.252539 | -1.639897 | 8.0 | 1.000000 | 0 | 0 | -3.500000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1948 |
| 4 | 0 | 0 | 79.000000 | 0.000000 | 0.022526 | 0 | 70.0 | 0.0 | 20.0 | 0.000000 | 0.750797 | 0.022462 | 34.164099 | 68.960291 | 0 | 0.000000 | 61.301547 | 4.198705 | 122.245074 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 118.312296 | 0.2718 | 43.602238 | 0.253 | 0.158074 | 0.052706 | 2.000000 | 72.850389 | 0 | 1.000000 | 16.270645 | -1.398367 | 8.0 | 1.000000 | 0 | 0 | 2.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1949 |
Firstly, we will quickly check if there is no faulty data.
# Dataset checking
na_vals = df_onset.isnull().values.any()
na_vals2 = (df_onset.values == -1).any()
print('Are there NA values in the dataset ? {}'.format(na_vals))
print('Are there -1 values in the dataset ? {}'.format(na_vals2))
Are there NA values in the dataset ? False Are there -1 values in the dataset ? True
There does not seem to be missing data. Let's have a look at if the -1 values are normal.
df_onset[df_onset.values == -1].head()
| warstds | anoc | ager | autonomy | avgnabo | dem | dlang | drace | drel | durable | ef | gdpgrowth | illiteracy | infant | inst | inst3 | life | lmtnest | milper | nat_war | ncontig | nwstate | oil | plural | plurrel | pol4 | pol4sq | popdense | relfrac | seceduc | second | sxpnew | sxpsq | tnatwar | trade | warhist | xconst | lpopns | ln_gdpen | numlang | proxregc | partfree | decade1 | regd4_alt | etdo4590 | geo1 | presi | parreg | geo34 | year | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 14 | 0 | 0 | 89.0 | 0.0 | 0.000000 | 0 | 70.0 | 0.0 | 20.0 | 58.0 | 0.750797 | 0.022505 | 34.016562 | 68.585281 | 0 | 0.0 | 61.382579 | 4.198705 | 121.828525 | 0 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 118.824075 | 0.2718 | 43.867330 | 0.253 | 0.157918 | 0.052794 | 0.0 | 72.770113 | 0 | 1.000000 | 16.410765 | -0.789658 | 8.0 | 1.200000e-35 | 0 | 0 | -1.0 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1959 |
| 16 | 0 | 0 | 91.0 | 0.0 | 0.000000 | 0 | 70.0 | 0.0 | 20.0 | 60.0 | 0.750797 | 0.022502 | 34.163884 | 68.985366 | 0 | 0.0 | 34.000000 | 4.198705 | 60.000000 | 0 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -10.000000 | 100.000000 | 15.661860 | 0.2718 | 1.000000 | 0.253 | 0.158188 | 0.052912 | 0.0 | 11.157030 | 0 | 1.000000 | 16.435966 | -0.685179 | 8.0 | 7.520000e-37 | 0 | 1 | -1.0 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1961 |
| 27 | 0 | 0 | 102.0 | 0.0 | 0.013187 | 0 | 70.0 | 0.0 | 20.0 | 7.0 | 0.750797 | 0.022584 | 87.699997 | 197.600006 | 0 | 0.0 | 37.200001 | 4.198705 | 83.000000 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -7.000000 | 49.000000 | 20.014311 | 0.2718 | 7.000000 | 0.253 | 0.047590 | 0.002265 | 1.0 | 27.063141 | 0 | 3.000000 | 16.544800 | -0.236989 | 8.0 | 6.100000e-05 | 0 | 0 | -1.0 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1972 |
| 170 | 0 | 1 | 20.0 | 0.0 | 0.491415 | 0 | 63.0 | 2.0 | 0.0 | 0.0 | 0.756100 | 0.068651 | 39.317896 | 130.199997 | 0 | 1.0 | 46.460999 | 2.370244 | 140.703166 | 1 | 1.0 | 0.0 | 1 | 0.38 | 47.0 | 0.075708 | 54.394127 | 8.800835 | 0.6122 | 12.300000 | 0.260 | 0.121891 | 0.033825 | 1.0 | 161.207901 | 0 | 3.919843 | 16.210857 | -0.767774 | 14.0 | 1.000000e+00 | 0 | 0 | -1.0 | 0.0 | 0.0 | 0 | 3.496771 | 0.0 | 1995 |
| 171 | 0 | 1 | 21.0 | 0.0 | 0.505966 | 0 | 63.0 | 2.0 | 0.0 | 0.0 | 0.756100 | 0.066215 | 35.943472 | 125.000000 | 0 | 1.0 | 46.460999 | 2.370244 | 138.001457 | 1 | 1.0 | 0.0 | 1 | 0.38 | 47.0 | -0.062680 | 59.074481 | 9.077709 | 0.6122 | 41.724662 | 0.260 | 0.149736 | 0.047833 | 1.0 | 147.406403 | 0 | 3.934028 | 16.241833 | -0.703517 | 14.0 | 1.000000e+00 | 0 | 0 | -1.0 | 0.0 | 0.0 | 0 | 3.741457 | 0.0 | 1996 |
print('These are the variables where there is at least one -1 value: \n {}'.format(df_onset.columns[np.any((df_onset.values == -1), axis=0)]))
These are the variables where there is at least one -1 value: Index(['pol4', 'regd4_alt'], dtype='object')
df_onset[df_onset.columns[np.any((df_onset.values == -1), axis=0)]].describe()
| pol4 | regd4_alt | |
|---|---|---|
| count | 7140.000000 | 7140.000000 |
| mean | -0.096553 | -0.838349 |
| std | 7.263610 | 6.460063 |
| min | -10.000000 | -8.500000 |
| 25% | -7.000000 | -7.000000 |
| 50% | -1.000000 | -3.000000 |
| 75% | 8.000000 | 5.500000 |
| max | 10.000000 | 10.000000 |
It seems that for all the variables, the values can be negative and positive, and are distributed on the whole range of possible values, so it seems normal that there are -1 values.
Next we will investigate if there are no out of range values.
df_onset.hist(figsize=(20,23))
plt.show()
There does not seem to be values out of range, abnormally big values. However, now in the dataset, there could be variables which could be redundant. We will try to see and keep only 1 of those variables. Also, some variables could have no valuable information for this analysis.
For the variables which appear also as squared, we will only keep the squared ones. This affects the sxpnew variable and the pol4 variable. We will drop numlang, the number of languages variable, since the linguistic fractionalization is already incorporated in the dlang variable. Between durable and proxregc, only the latter one will be kept since being some preprocessed feature.
df_onset.drop(columns=['durable', 'pol4', 'sxpnew', 'numlang'], inplace=True)
Next we will verify if this dataset provides some variable for civil war duration and prepare the dataset for civil war end prediction.
df_on['atwards'].describe()
count 7140.000000 mean 0.125630 std 0.331455 min 0.000000 25% 0.000000 50% 0.000000 75% 0.000000 max 1.000000 Name: atwards, dtype: float64
atwards is the variable indicating if a country was at war in a given year. With some data wrangling, atwards could be a good variable for civil war duration indication. But it is not very precise ( only years ).
duration = df_on.groupby('id')['atwards'].agg('sum')
duration.describe()
count 187.000000 mean 4.796791 std 8.748050 min 0.000000 25% 0.000000 50% 0.000000 75% 5.000000 max 48.000000 Name: atwards, dtype: float64
The duration of civil wars in years is rather small, and so the time granularity might not be sufficient to produce good estimates of duration. Instead, we will predict, for a given year, if the war has stopped. To that end, we add a new variable, warend, which is 1 if the war has ended this year (atwards switched from 0 to 1 this year), and 0 if the war is still ongoing (atwards is 1). Note that hear we do not drop the variables that were selected for the onset prediction. The reason why is that the prediction is significantly better this way for civil war ending. The prediction of civil war ending is in fact the subject of discussion (on the order of causality) in the end of this project, and thus it does not really matter if the causal factors are chosen well in advance.
# Add a column corresponding to if a civil war ended this year
df_end = df_on[df_on['atwards']==1]
df_end = warend_labels('atwards',df_end,df_on)
# Add alpha3 country code
df_end['cowalpha'] = df_end.cowcode.map(stateabb_mapping)
df_end['statename'] = df_end.cowcode.map(statename_mapping)
df_end = df_end[warend_vars+['cowalpha']+['statename']]
df_end.head()
| warend | anoc | ager | autonomy | avgnabo | dem | dlang | drace | drel | durable | ef | gdpgrowth | illiteracy | infant | inst | inst3 | life | lmtnest | milper | nat_war | ncontig | nwstate | oil | plural | plurrel | pol4 | pol4sq | popdense | relfrac | seceduc | second | sxpnew | sxpsq | tnatwar | trade | warhist | xconst | lpopns | ln_gdpen | numlang | proxregc | partfree | decade1 | regd4_alt | etdo4590 | geo1 | presi | parreg | geo34 | cowalpha | statename | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 33 | 0 | 0 | 108.0 | 0.0 | 0.0 | 0 | 70.0 | 0.0 | 20.0 | 13.0 | 0.750797 | -0.002629 | 82.900002 | 194.0 | 0 | 1.0 | 40.000000 | 4.198705 | 143.0 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -7.000000 | 49.000000 | 23.236290 | 0.2718 | 8.0 | 0.253 | 0.077570 | 0.006017 | 1.0 | 26.486080 | 0 | 1.000000 | 16.593708 | -0.002002 | 8.0 | 1.490000e-08 | 0 | 0 | -7.0 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | AFG | Afghanistan |
| 34 | 0 | 1 | 109.0 | 0.0 | 0.0 | 0 | 70.0 | 0.0 | 20.0 | 0.0 | 0.750797 | 0.000803 | 82.099998 | 194.0 | 0 | 1.0 | 40.000000 | 4.198705 | 110.0 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -1.024909 | 47.211886 | 23.842110 | 0.2718 | 8.0 | 0.253 | 0.102470 | 0.022082 | 1.0 | 24.713800 | 0 | 3.562772 | 16.601755 | 0.006976 | 8.0 | 1.000000e+00 | 0 | 0 | -5.0 | 1.0 | 0.0 | 0 | 3.412579 | 0.0 | AFG | Afghanistan |
| 35 | 0 | 0 | 110.0 | 0.0 | 0.0 | 0 | 70.0 | 0.0 | 20.0 | 0.0 | 0.750797 | 0.000680 | 81.699997 | 194.0 | 0 | 1.0 | 40.000000 | 4.198705 | 89.0 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -7.000000 | 49.000000 | 24.459810 | 0.2718 | 8.0 | 0.253 | 0.102335 | 0.022051 | 1.0 | 47.573419 | 0 | 3.000000 | 16.609922 | -0.034591 | 8.0 | 1.000000e+00 | 0 | 0 | -6.0 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | AFG | Afghanistan |
| 36 | 0 | 0 | 111.0 | 0.0 | 0.0 | 0 | 70.0 | 0.0 | 20.0 | 1.0 | 0.750797 | 0.000813 | 82.000000 | 183.0 | 0 | 1.0 | 40.487801 | 4.198705 | 40.0 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -7.000000 | 49.000000 | 25.090099 | 0.2718 | 10.0 | 0.253 | 0.102302 | 0.022109 | 1.0 | 47.526501 | 0 | 3.000000 | 16.618689 | -0.012073 | 8.0 | 2.500000e-01 | 0 | 0 | -7.0 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | AFG | Afghanistan |
| 37 | 0 | 0 | 112.0 | 0.0 | 0.0 | 0 | 70.0 | 0.0 | 20.0 | 2.0 | 0.750797 | 0.000831 | 80.500000 | 183.0 | 0 | 0.0 | 40.487801 | 4.198705 | 43.0 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | -7.000000 | 49.000000 | 25.733120 | 0.2718 | 10.0 | 0.253 | 0.102233 | 0.022012 | 1.0 | 47.572445 | 0 | 3.000000 | 16.636055 | 0.021761 | 8.0 | 6.250000e-02 | 0 | 0 | -4.0 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | AFG | Afghanistan |
In order to get a better of sense of the data at hand and how the civil war onsets are spread across the world, we perform some data exploration here. We will use world maps also later on in the project in order to study wether the predictors found indeed show up on the maps. The idea here is to be convinced that civil wars are still frequent in modern times, and that it is an issue that must be dealt with.
Here is the map of the number of civil war onsets a country has seen since 1945.
# Group by country and sum to get total of civil war onsets per country
df_numonset = df_on.groupby(['cowcode'])['warstds'].agg('sum').reset_index().set_index(['cowcode']).reset_index()
df_numonset = df_numonset[df_numonset['warstds']>0] # Discard if no onset
df_numonset['cowalpha'] = df_numonset.cowcode.map(stateabb_mapping)
df_numonset['statename'] = df_numonset.cowcode.map(statename_mapping)
df_numonset.rename(columns={'warstds':'Number of civil war onsets'}, inplace=True)
df_numonset.head()
| cowcode | Number of civil war onsets | cowalpha | statename | |
|---|---|---|---|---|
| 3 | 40 | 1 | CUB | Cuba |
| 4 | 41 | 1 | HAI | Haiti |
| 5 | 42 | 1 | DOM | Dominican Republic |
| 10 | 70 | 1 | MEX | Mexico |
| 12 | 90 | 3 | GUA | Guatemala |
fig = px.choropleth(df_numonset, locations="cowalpha",
color="Number of civil war onsets",
hover_name="statename",
color_continuous_scale=px.colors.sequential.Plasma)
fig.update_layout(title='Map of number of civil war onsets',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/map_onset.html", 'w') as file:
file.write(html)
The world regions most struck by civil wars are Latin America, Eastern Africa and the Middle East. Some countries, such as Nicaragua India and Iraq have seen up to 3 civil wars since 1945. Seeing such results, geographical, economic and temporal patterns should influence a country going into civil war or not.
Here is the map of the number of years a country has been in civil war (can span different civil wars).
# Group by country and sum to get total of years at war per country
df_durwar = df_on.groupby(['cowcode'])['atwards'].agg('sum').reset_index().set_index(['cowcode']).reset_index()
df_durwar = df_durwar[df_durwar['atwards']>0] # Discard if no years at war
df_durwar['cowalpha'] = df_durwar.cowcode.map(stateabb_mapping)
df_durwar['statename'] = df_durwar.cowcode.map(statename_mapping)
df_durwar.rename(columns={'atwards':'Years of civil war'}, inplace=True)
df_durwar.head()
| cowcode | Years of civil war | cowalpha | statename | |
|---|---|---|---|---|
| 3 | 40 | 2 | CUB | Cuba |
| 4 | 41 | 4 | HAI | Haiti |
| 5 | 42 | 1 | DOM | Dominican Republic |
| 10 | 70 | 3 | MEX | Mexico |
| 12 | 90 | 25 | GUA | Guatemala |
fig = px.choropleth(df_durwar, locations="cowalpha",
color="Years of civil war",
hover_name="statename",
color_continuous_scale=px.colors.sequential.Plasma)
fig.update_layout(title='Map of number of years spent in civil war conflict',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/map_duration.html", 'w') as file:
file.write(html)
Some countries, such as Colombia, have been in civil war for decades. Those are also not necessarily the same ones that have seen the most onsets. Seeing how long civil wars can last, and knowing how destructive they are, the importance of understanding their causal factors is evident.
In this part, we will firstly predict civil war onset using the 2 methods of interest, Random Forest and Neural Networks. We will then study the predictive power of the two methods by plotting their ROC curves, along with the AUC score. This methods was also used by the authors. The ROC curve is useful in the context of class imbalance since we do not know the threshold for good classification a priori. This metric also gives a good idea of the robustness of the prediction. We will also perform dimensionality reduction on the activations of the last hidden layer of the MLP in order to get a better insight in how this type of model is able to learn non-linear mappings between features and prediction. This kind of approach would also be useful when using inputs of different modalities (visual, temporal). We will then look at the feature importances using permutation importance on a test set. Finally, we will plot some of these important variables on a world map for both values of the dependent variable.
# Train RF and MLP to predict civil war onset and gather predictions and importances
rf_onset,mlp_onset,df_rf_onset_predict,df_mlp_onset_predict,importances_onset = train_models('warstds',df_onset.drop(['year'],axis=1),SEARCH_ITER,DATA_SPLIT,CV,SEED)
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 1.1min [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 3.0min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 31.0s /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.7min finished
WARNING:tensorflow:From /home/matthieulc/.local/lib/python3.6/site-packages/tensorflow/python/ops/nn_impl.py:180: add_dispatch_support.<locals>.wrapper (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.where in 2.0, which has the same broadcast rule as np.where WARNING:tensorflow:From /home/matthieulc/.local/lib/python3.6/site-packages/keras/backend/tensorflow_backend.py:422: The name tf.global_variables is deprecated. Please use tf.compat.v1.global_variables instead. Epoch 1/120 5355/5355 [==============================] - 0s 47us/step - loss: 1.6555 - accuracy: 0.1460 Epoch 2/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.6541 - accuracy: 0.1696 Epoch 3/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.6063 - accuracy: 0.1938 Epoch 4/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.6214 - accuracy: 0.2187 Epoch 5/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.4946 - accuracy: 0.2547 Epoch 6/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.5563 - accuracy: 0.2702 Epoch 7/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.4925 - accuracy: 0.2993 Epoch 8/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.4454 - accuracy: 0.3163 Epoch 9/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.4638 - accuracy: 0.3535 Epoch 10/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.4632 - accuracy: 0.3696 Epoch 11/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.4158 - accuracy: 0.3972 Epoch 12/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3802 - accuracy: 0.4138 Epoch 13/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.4228 - accuracy: 0.4355 Epoch 14/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.4261 - accuracy: 0.4471 Epoch 15/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3636 - accuracy: 0.4627 Epoch 16/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3651 - accuracy: 0.4719 Epoch 17/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3658 - accuracy: 0.4796 Epoch 18/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3949 - accuracy: 0.5007 Epoch 19/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3167 - accuracy: 0.4969 Epoch 20/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3147 - accuracy: 0.5048 Epoch 21/120 5355/5355 [==============================] - 0s 2us/step - loss: 1.3089 - accuracy: 0.5111 Epoch 22/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.2904 - accuracy: 0.5150 Epoch 23/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3187 - accuracy: 0.5246 Epoch 24/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3229 - accuracy: 0.5259 Epoch 25/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.2839 - accuracy: 0.5438 Epoch 26/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.3441 - accuracy: 0.5430 Epoch 27/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.2411 - accuracy: 0.5430 Epoch 28/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.2940 - accuracy: 0.5410 Epoch 29/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.2387 - accuracy: 0.5556 Epoch 30/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.2258 - accuracy: 0.5546 Epoch 31/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.2475 - accuracy: 0.5641 Epoch 32/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.2489 - accuracy: 0.5630 Epoch 33/120 5355/5355 [==============================] - 0s 7us/step - loss: 1.2674 - accuracy: 0.5636 Epoch 34/120 5355/5355 [==============================] - 0s 5us/step - loss: 1.2560 - accuracy: 0.5696 Epoch 35/120 5355/5355 [==============================] - 0s 7us/step - loss: 1.1918 - accuracy: 0.5699 Epoch 36/120 5355/5355 [==============================] - 0s 7us/step - loss: 1.2190 - accuracy: 0.5824 Epoch 37/120 5355/5355 [==============================] - 0s 7us/step - loss: 1.2581 - accuracy: 0.5765 Epoch 38/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.2338 - accuracy: 0.5810 Epoch 39/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.1833 - accuracy: 0.5838 Epoch 40/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.2525 - accuracy: 0.5970 Epoch 41/120 5355/5355 [==============================] - 0s 5us/step - loss: 1.1847 - accuracy: 0.5976 Epoch 42/120 5355/5355 [==============================] - 0s 5us/step - loss: 1.1853 - accuracy: 0.5976 Epoch 43/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.1491 - accuracy: 0.5953 Epoch 44/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1274 - accuracy: 0.6093 Epoch 45/120 5355/5355 [==============================] - 0s 5us/step - loss: 1.2115 - accuracy: 0.6097 Epoch 46/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0791 - accuracy: 0.6123 Epoch 47/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1420 - accuracy: 0.6233 Epoch 48/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1849 - accuracy: 0.6273 Epoch 49/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.1454 - accuracy: 0.6215 Epoch 50/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.1818 - accuracy: 0.6297 Epoch 51/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.1685 - accuracy: 0.6364 Epoch 52/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1079 - accuracy: 0.6351 Epoch 53/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1804 - accuracy: 0.6360 Epoch 54/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1235 - accuracy: 0.6424 Epoch 55/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0818 - accuracy: 0.6430 Epoch 56/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0778 - accuracy: 0.6568 Epoch 57/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1407 - accuracy: 0.6480 Epoch 58/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0648 - accuracy: 0.6519 Epoch 59/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0647 - accuracy: 0.6588 Epoch 60/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1569 - accuracy: 0.6515 Epoch 61/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.0490 - accuracy: 0.6629 Epoch 62/120 5355/5355 [==============================] - 0s 2us/step - loss: 1.0275 - accuracy: 0.6670 Epoch 63/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0867 - accuracy: 0.6743 Epoch 64/120 5355/5355 [==============================] - 0s 2us/step - loss: 1.1008 - accuracy: 0.6734 Epoch 65/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0995 - accuracy: 0.6730 Epoch 66/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0679 - accuracy: 0.6687 Epoch 67/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.1084 - accuracy: 0.6775 Epoch 68/120 5355/5355 [==============================] - 0s 2us/step - loss: 1.1057 - accuracy: 0.6734 Epoch 69/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0738 - accuracy: 0.6779 Epoch 70/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0180 - accuracy: 0.6874 Epoch 71/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0247 - accuracy: 0.6812 Epoch 72/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0380 - accuracy: 0.6734 Epoch 73/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.9890 - accuracy: 0.6846 Epoch 74/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0693 - accuracy: 0.6788 Epoch 75/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0289 - accuracy: 0.6844 Epoch 76/120 5355/5355 [==============================] - 0s 2us/step - loss: 1.0573 - accuracy: 0.6807 Epoch 77/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.0163 - accuracy: 0.6805 Epoch 78/120 5355/5355 [==============================] - 0s 5us/step - loss: 0.9778 - accuracy: 0.6926 Epoch 79/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0025 - accuracy: 0.6917 Epoch 80/120 5355/5355 [==============================] - 0s 4us/step - loss: 1.0004 - accuracy: 0.6908 Epoch 81/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9949 - accuracy: 0.6947 Epoch 82/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9778 - accuracy: 0.6967 Epoch 83/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.9510 - accuracy: 0.7077 Epoch 84/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0184 - accuracy: 0.7063 Epoch 85/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.9893 - accuracy: 0.7115 Epoch 86/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9710 - accuracy: 0.7113 Epoch 87/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0275 - accuracy: 0.7163 Epoch 88/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9598 - accuracy: 0.7126 Epoch 89/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.9564 - accuracy: 0.7225 Epoch 90/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.9821 - accuracy: 0.7221 Epoch 91/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9688 - accuracy: 0.7169 Epoch 92/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.9748 - accuracy: 0.7165 Epoch 93/120 5355/5355 [==============================] - 0s 3us/step - loss: 1.0086 - accuracy: 0.7141 Epoch 94/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.9264 - accuracy: 0.7195 Epoch 95/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9311 - accuracy: 0.7083 Epoch 96/120 5355/5355 [==============================] - 0s 2us/step - loss: 0.9007 - accuracy: 0.7212 Epoch 97/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.9667 - accuracy: 0.7234 Epoch 98/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9149 - accuracy: 0.7274 Epoch 99/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9281 - accuracy: 0.7277 Epoch 100/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.8857 - accuracy: 0.7277 Epoch 101/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9295 - accuracy: 0.7307 Epoch 102/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9325 - accuracy: 0.7331 Epoch 103/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8925 - accuracy: 0.7373 Epoch 104/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9425 - accuracy: 0.7387 Epoch 105/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8777 - accuracy: 0.7378 Epoch 106/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8956 - accuracy: 0.7374 Epoch 107/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9850 - accuracy: 0.7374 Epoch 108/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.8799 - accuracy: 0.7374 Epoch 109/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9134 - accuracy: 0.7378 Epoch 110/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.8985 - accuracy: 0.7387 Epoch 111/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.8777 - accuracy: 0.7376 Epoch 112/120 5355/5355 [==============================] - 0s 4us/step - loss: 0.9028 - accuracy: 0.7376 Epoch 113/120 5355/5355 [==============================] - 0s 2us/step - loss: 0.8707 - accuracy: 0.7541 Epoch 114/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8876 - accuracy: 0.7457 Epoch 115/120 5355/5355 [==============================] - 0s 2us/step - loss: 0.8927 - accuracy: 0.7492 Epoch 116/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8993 - accuracy: 0.7472 Epoch 117/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8716 - accuracy: 0.7537 Epoch 118/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8858 - accuracy: 0.7449 Epoch 119/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8831 - accuracy: 0.7556 Epoch 120/120 5355/5355 [==============================] - 0s 3us/step - loss: 0.8077 - accuracy: 0.7529 3512/3512 [==============================] - 0s 9us/step 3512/3512 [==============================] - 0s 10us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 8us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 3us/step 3512/3512 [==============================] - 0s 4us/step 3512/3512 [==============================] - 0s 5us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 3us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 3us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 2us/step 3512/3512 [==============================] - 0s 1us/step 3512/3512 [==============================] - 0s 1us/step
fig = go.Figure()
fig.add_shape(
type='line', line=dict(dash='dash'),
x0=0, x1=1, y0=0, y1=1
)
# Generate ROC curve and thresholds
fpr_rf_onset, tpr_rf_onset, thr_rf_onset = roc_curve(df_rf_onset_predict.Label, df_rf_onset_predict.Predicted)
fpr_mlp_onset, tpr_mlp_onset, thr_mlp_onset = roc_curve(df_mlp_onset_predict.Label, df_mlp_onset_predict.Predicted)
# Calculate AUC
auc_rf_onset = auc(fpr_rf_onset, tpr_rf_onset)
auc_mlp_onset = auc(fpr_mlp_onset, tpr_mlp_onset)
# Plot
fig.add_trace(go.Scatter(x=fpr_rf_onset, y=tpr_rf_onset, name='Random Forest (AUC = %0.3f)'% auc_rf_onset, mode='lines'))
fig.add_trace(go.Scatter(x=fpr_mlp_onset, y=tpr_mlp_onset, name='Multi Layer Perceptron (AUC = %0.3f)'% auc_mlp_onset, mode='lines'))
fig.update_layout(
xaxis_title='False Positive Rate',
yaxis_title='True Positive Rate',
yaxis=dict(scaleanchor="x", scaleratio=1),
xaxis=dict(constrain='domain'),
width=700, height=500,
title="ROC curve for civil war onset"
)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/roc_onset.html", 'w') as file:
file.write(html)
The ROC curves yield good results for both approaches, with a slight advantage for RF. In all cases, both approaches are better than the traditional statistical approaches presented in the original paper. As we will see in the rest of the project, MLPs are less powerfull at handling imbalanced data than RFs.
# Scale whole dataset
df_onset_X = df_onset.drop(['warstds','year'],axis=1)
scaler = StandardScaler().fit(df_onset_X)
df_onset_X = scaler.transform(df_onset_X)
# Retrieve up to second-to-last layer of the trained MLP to generate the embeddings
mlp_onset_enc = keras.models.Sequential([
mlp_onset.model.layers[0],
mlp_onset.model.layers[1],
mlp_onset.model.layers[2]
])
# Clone the model with random weights for control
mlp_onset_enc_u = keras.models.clone_model(mlp_onset_enc)
# Perform dimensionality reduction with t-SNE on the features directly
tsne_f_onset = TSNE(n_components=2,perplexity=30).fit_transform(df_onset_X)
tx_f_onset = tsne_f_onset[:, 0]
ty_f_onset = tsne_f_onset[:, 1]
# Perform dimensionality reduction with t-SNE on the untrained embeddings/activations
tsne_ua_onset = TSNE(n_components=2,perplexity=30).fit_transform(mlp_onset_enc_u.predict(df_onset_X))
tx_ua_onset = tsne_ua_onset[:, 0]
ty_ua_onset = tsne_ua_onset[:, 1]
# Perform dimensionality reduction with t-SNE on the trained embeddings/activations
tsne_a_onset = TSNE(n_components=2,perplexity=30).fit_transform(mlp_onset_enc.predict(df_onset_X))
tx_a_onset = tsne_a_onset[:, 0]
ty_a_onset = tsne_a_onset[:, 1]
fig = make_subplots(rows=1, cols=3,
subplot_titles=("Features","Untrained activations", "Trained activations"))
# Generate the color labels
color_labels = ['mediumblue' if x is 1 else 'lightsalmon' for x in df_onset['warstds']]
# Add the feature plot
fig.add_trace(go.Scatter(x=tx_f_onset,y=ty_f_onset,mode='markers',marker_color=color_labels,showlegend=False),row=1, col=1)
# Add the untrained activations plot
fig.add_trace(
go.Scatter(x=tx_ua_onset, y=ty_ua_onset,mode='markers',marker_color=color_labels,showlegend=False),
row=1, col=2
)
# Add the trained activations plot
fig.add_trace(
go.Scatter(x=tx_a_onset, y=ty_a_onset,mode='markers',marker_color=color_labels,showlegend=False),
row=1, col=3
)
# Add color legends
fig.add_trace(go.Scatter(x=[None], y=[None], mode='markers',
marker_color='mediumblue',
legendgroup='Civil war onset', showlegend=True, name='Civil war onset'))
fig.add_trace(go.Scatter(x=[None], y=[None], mode='markers',
marker_color='lightsalmon',
legendgroup='No civil war onset', showlegend=True, name='No civil war onset'))
fig.update_layout(height=500, width=1200, title_text="Visualization of the datapoints using t-SNE for dimensionality reduction")
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/tsne_onset.html", 'w') as file:
file.write(html)
Here are the activations of the last hidden layer of the MLP for the dataset. We also use two controls - the features and untrained activations - in order to put into perspective the results, as it is often with ANNs that even untrained networks can have well clustered activations due to the input distribution. Here we see that indeed the trained MLP is able to group the civil war onset datapoints (top-right) better than the controls. Still we see that the cluster overlaps with some negative datapoints. This shows that the MLP is able to extract some mapping from the features in order to group somewhat separately the two events (civil war onset and no onset) to make a prediction.
# Plot feature importance for RF and MLP
fig = px.bar(importances_onset, x="Names", y="Scores", color="Model", title="Permutation importance scores for civil war onset")
fig.update_xaxes(tickangle=45)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/imp_onset.html", 'w') as file:
file.write(html)
This plot shows the importance of each of the features using permutation importance. Permutation importance on a test set informs on the features that are importance for generalization. Here, two things are important: some features are very important for both models, and some features have contradicting importance even if the two models have similar predicting power. This last points highlights that talking about causality when using machine learning techniques is risky, as different models can leverage differently the features for prediction. However, some features are clearly very important for both models, such as primary commodity exports/GDP squared sxpsq, trade as percept of GDP trade, autonomous regions autonomy, rough terrain lmtnest, percentage of illiteracy illiteracy, and military power milper. This analysis corroborates some of the results of the original paper with the new model. However, some features such as the GDP growth gdpgrowth show contradicting predictive power on the test set, which goes against what the original paper shows. Also, whether the state is new or not nwstate shows high predictive power in both models, which is novel from the original paper.
sxpsq¶Here we plot one of the most important features for both values of warstds in order to see if countries indeed show different values.
traces = []
buttons = []
# Add a map for the negative class
traces.append(go.Choropleth(
locations=df_on[df_on['warstds']==0]['cowalpha'],
z=df_onset[df_on['warstds']==0]['sxpsq'].astype(float),
colorbar_title='Primary commodity exports/GDP (squared)',
visible= True,
hovertext=df_on[df_on['warstds']==0]['statename']))
# Add a button for the negative class
buttons.append(dict(label='No civil war onset',
method="update",
args=[{"visible":[True,False]},
{"title":'Primary commodity exports/GDP when no civil war onset occured (squared)'}]))
# Add a map for the positive class
traces.append(go.Choropleth(
locations=df_on[df_on['warstds']==1]['cowalpha'],
z=df_onset[df_on['warstds']==1]['sxpsq'].astype(float),
colorbar_title='Primary commodity exports/GDP (squared)',
visible= False,
hovertext=df_on[df_on['warstds']==1]['statename']))
# Add a button for the negative class
buttons.append(dict(label='Civil war onset',
method="update",
args=[{"visible":[False,True]},
{"title":'Primary commodity exports/GDP during civil war onset (squared)'}]))
# Initialize
updatemenus = [{"active":0,
"buttons":buttons,
}]
# Show figure
fig = go.Figure(data=traces,
layout=dict(updatemenus=updatemenus))
fig.update_layout(title='Primary commodity exports/GDP when no civil war onset occured (squared)',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/map_gdp_onset.html", 'w') as file:
file.write(html)
We clearly observe than indeed, countries experiencing a civil war onset have a noteworthy decrease in primary commodity exports/GDP. Peru for instance, has seen, on average, a drop from 0.05 to 0.006, nearly an order of magnitude less.
Here we plot one of the most important features for both values of warstds in order to see if countries indeed show different values.
traces = []
buttons = []
# Add a map for the negative class
traces.append(go.Choropleth(
locations=df_on[df_on['warstds']==0]['cowalpha'],
z=df_onset[df_on['warstds']==0]['illiteracy'].astype(float),
colorbar_title='Illiteracy',
visible= True,
hovertext=df_on[df_on['warstds']==0]['statename']))
# Add a button for the negative class
buttons.append(dict(label='No civil war onset',
method="update",
args=[{"visible":[True,False]},
{"title":'Illiteracy when no civil war onset occured'}]))
# Add a map for the positive class
traces.append(go.Choropleth(
locations=df_on[df_on['warstds']==1]['cowalpha'],
z=df_onset[df_on['warstds']==1]['illiteracy'].astype(float),
colorbar_title='Illiteracy',
visible= False,
hovertext=df_on[df_on['warstds']==1]['statename']))
# Add a button for the positive class
buttons.append(dict(label='Civil war onset',
method="update",
args=[{"visible":[False,True]},
{"title":'Illiteracy during civil war onset'}]))
# Initialize
updatemenus = [{"active":0,
"buttons":buttons,
}]
# Show figure
fig = go.Figure(data=traces,
layout=dict(updatemenus=updatemenus))
fig.update_layout(title='Illiteracy when no civil war onset occured',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/map_illiteracy_onset.html", 'w') as file:
file.write(html)
Similarly, we see that states experiencing a civil war onset have higher rates of illiteracy. One staggering example is that of Afghanistan, where illiteracy increased from 34% to 83% at the time of the onset.
As we saw before in the dataset exploration graph, the features of civil war onsets change during the years. In this part we will try to see if there is a difference in the causal aspects of civil war onset over the years. For this we will analyze the feature importances. We will train Random Forest Classifiers and Neural Networks as civil war onset predictors on bins of data of 15 years, evenly spaced of 5 years.
Firstly, we separate the data into bins.
# Separate data into bins of 15 years periods
df_bins = []
for year in np.sort(df_onset['year'].unique()):
if not year%5 and year != 1945 and year != 1995 and year != 2000 : #
df_bins.append(pd.DataFrame(df_onset.loc[around(df_onset['year'],year)].drop(columns='year')))
Next we will train the predictors, and get the feature importances.
# Building predictors and evaluating importances for each bin of 15 years
periods = ['1945 - 1960', '1950 - 1965', '1955 - 1970', '1960 - 1975', '1965 - 1980', '1970 - 1985', '1975 - 1990', '1980 - 1995', '1985 - 2000']
rf_bins = []
mlp_bins = []
rf_predict_bins = []
mlp_predict_bins = []
all_importances= pd.DataFrame()
for i,df in enumerate(df_bins):
rf,mlp,df_rf_predict,df_mlp_predict,importances = train_models('warstds',df,SEARCH_ITER,DATA_SPLIT,CV,SEED,'bins')
rf_bins.append(rf)
mlp_bins.append(mlp)
rf_predict_bins.append(df_rf_predict)
mlp_predict_bins.append(df_mlp_predict)
importances['period'] = periods[i]
all_importances = all_importances.append(importances)
print('Bin {}/9'.format(i+1))
print('Finished all bins')
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 35.1s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.6min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 25.9s /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.4min finished
Epoch 1/120 963/963 [==============================] - 0s 211us/step - loss: 1.3147 - accuracy: 0.5358 Epoch 2/120 963/963 [==============================] - 0s 5us/step - loss: 1.2131 - accuracy: 0.5389 Epoch 3/120 963/963 [==============================] - 0s 5us/step - loss: 1.0907 - accuracy: 0.5202 Epoch 4/120 963/963 [==============================] - 0s 6us/step - loss: 0.9177 - accuracy: 0.5618 Epoch 5/120 963/963 [==============================] - 0s 4us/step - loss: 0.9162 - accuracy: 0.5950 Epoch 6/120 963/963 [==============================] - 0s 4us/step - loss: 0.9433 - accuracy: 0.5929 Epoch 7/120 963/963 [==============================] - 0s 7us/step - loss: 0.9543 - accuracy: 0.5971 Epoch 8/120 963/963 [==============================] - 0s 6us/step - loss: 0.8926 - accuracy: 0.5919 Epoch 9/120 963/963 [==============================] - 0s 4us/step - loss: 0.7935 - accuracy: 0.6428 Epoch 10/120 963/963 [==============================] - 0s 4us/step - loss: 0.7642 - accuracy: 0.6636 Epoch 11/120 963/963 [==============================] - 0s 4us/step - loss: 0.7872 - accuracy: 0.7009 Epoch 12/120 963/963 [==============================] - 0s 4us/step - loss: 0.7258 - accuracy: 0.7030 Epoch 13/120 963/963 [==============================] - 0s 6us/step - loss: 0.7735 - accuracy: 0.7165 Epoch 14/120 963/963 [==============================] - 0s 6us/step - loss: 0.6714 - accuracy: 0.7456 Epoch 15/120 963/963 [==============================] - 0s 5us/step - loss: 0.6679 - accuracy: 0.7715 Epoch 16/120 963/963 [==============================] - 0s 5us/step - loss: 0.6864 - accuracy: 0.7882 Epoch 17/120 963/963 [==============================] - 0s 4us/step - loss: 0.6183 - accuracy: 0.8214 Epoch 18/120 963/963 [==============================] - 0s 4us/step - loss: 0.6183 - accuracy: 0.8339 Epoch 19/120 963/963 [==============================] - 0s 10us/step - loss: 0.6868 - accuracy: 0.8380 Epoch 20/120 963/963 [==============================] - 0s 12us/step - loss: 0.6252 - accuracy: 0.8567 Epoch 21/120 963/963 [==============================] - 0s 4us/step - loss: 0.6147 - accuracy: 0.8671 Epoch 22/120 963/963 [==============================] - 0s 5us/step - loss: 0.5577 - accuracy: 0.8733 Epoch 23/120 963/963 [==============================] - 0s 6us/step - loss: 0.5665 - accuracy: 0.9107 Epoch 24/120 963/963 [==============================] - 0s 5us/step - loss: 0.5411 - accuracy: 0.9200 Epoch 25/120 963/963 [==============================] - 0s 5us/step - loss: 0.5350 - accuracy: 0.9138 Epoch 26/120 963/963 [==============================] - 0s 7us/step - loss: 0.5162 - accuracy: 0.9273 Epoch 27/120 963/963 [==============================] - 0s 7us/step - loss: 0.5146 - accuracy: 0.9221 Epoch 28/120 963/963 [==============================] - 0s 6us/step - loss: 0.5574 - accuracy: 0.9315 Epoch 29/120 963/963 [==============================] - 0s 6us/step - loss: 0.4909 - accuracy: 0.9315 Epoch 30/120 963/963 [==============================] - 0s 6us/step - loss: 0.4555 - accuracy: 0.9470 Epoch 31/120 963/963 [==============================] - 0s 6us/step - loss: 0.4616 - accuracy: 0.9460 Epoch 32/120 963/963 [==============================] - 0s 8us/step - loss: 0.4577 - accuracy: 0.9522 Epoch 33/120 963/963 [==============================] - 0s 6us/step - loss: 0.4391 - accuracy: 0.9564 Epoch 34/120 963/963 [==============================] - 0s 8us/step - loss: 0.4360 - accuracy: 0.9491 Epoch 35/120 963/963 [==============================] - 0s 5us/step - loss: 0.4420 - accuracy: 0.9605 Epoch 36/120 963/963 [==============================] - 0s 5us/step - loss: 0.3882 - accuracy: 0.9574 Epoch 37/120 963/963 [==============================] - 0s 7us/step - loss: 0.4062 - accuracy: 0.9564 Epoch 38/120 963/963 [==============================] - 0s 9us/step - loss: 0.4116 - accuracy: 0.9637 Epoch 39/120 963/963 [==============================] - 0s 5us/step - loss: 0.3623 - accuracy: 0.9585 Epoch 40/120 963/963 [==============================] - 0s 4us/step - loss: 0.3634 - accuracy: 0.9595 Epoch 41/120 963/963 [==============================] - 0s 6us/step - loss: 0.3712 - accuracy: 0.9668 Epoch 42/120 963/963 [==============================] - 0s 4us/step - loss: 0.3716 - accuracy: 0.9626 Epoch 43/120 963/963 [==============================] - 0s 7us/step - loss: 0.3457 - accuracy: 0.9616 Epoch 44/120 963/963 [==============================] - 0s 5us/step - loss: 0.3700 - accuracy: 0.9637 Epoch 45/120 963/963 [==============================] - 0s 6us/step - loss: 0.3865 - accuracy: 0.9678 Epoch 46/120 963/963 [==============================] - 0s 5us/step - loss: 0.3256 - accuracy: 0.9668 Epoch 47/120 963/963 [==============================] - 0s 5us/step - loss: 0.3536 - accuracy: 0.9637 Epoch 48/120 963/963 [==============================] - 0s 4us/step - loss: 0.3532 - accuracy: 0.9678 Epoch 49/120 963/963 [==============================] - 0s 5us/step - loss: 0.3061 - accuracy: 0.9668 Epoch 50/120 963/963 [==============================] - 0s 4us/step - loss: 0.3219 - accuracy: 0.9626 Epoch 51/120 963/963 [==============================] - 0s 7us/step - loss: 0.3252 - accuracy: 0.9626 Epoch 52/120 963/963 [==============================] - 0s 5us/step - loss: 0.3251 - accuracy: 0.9668 Epoch 53/120 963/963 [==============================] - 0s 7us/step - loss: 0.2855 - accuracy: 0.9678 Epoch 54/120 963/963 [==============================] - 0s 5us/step - loss: 0.2980 - accuracy: 0.9657 Epoch 55/120 963/963 [==============================] - 0s 8us/step - loss: 0.2911 - accuracy: 0.9668 Epoch 56/120 963/963 [==============================] - 0s 6us/step - loss: 0.2638 - accuracy: 0.9668 Epoch 57/120 963/963 [==============================] - 0s 9us/step - loss: 0.2622 - accuracy: 0.9657 Epoch 58/120 963/963 [==============================] - 0s 4us/step - loss: 0.2809 - accuracy: 0.9668 Epoch 59/120 963/963 [==============================] - 0s 5us/step - loss: 0.2740 - accuracy: 0.9657 Epoch 60/120 963/963 [==============================] - 0s 4us/step - loss: 0.2661 - accuracy: 0.9678 Epoch 61/120 963/963 [==============================] - 0s 4us/step - loss: 0.2842 - accuracy: 0.9678 Epoch 62/120 963/963 [==============================] - 0s 5us/step - loss: 0.2539 - accuracy: 0.9668 Epoch 63/120 963/963 [==============================] - 0s 5us/step - loss: 0.2465 - accuracy: 0.9688 Epoch 64/120 963/963 [==============================] - 0s 5us/step - loss: 0.2845 - accuracy: 0.9688 Epoch 65/120 963/963 [==============================] - 0s 9us/step - loss: 0.2379 - accuracy: 0.9678 Epoch 66/120 963/963 [==============================] - 0s 8us/step - loss: 0.2658 - accuracy: 0.9699 Epoch 67/120 963/963 [==============================] - 0s 6us/step - loss: 0.2616 - accuracy: 0.9678 Epoch 68/120 963/963 [==============================] - 0s 6us/step - loss: 0.2419 - accuracy: 0.9668 Epoch 69/120 963/963 [==============================] - 0s 8us/step - loss: 0.2473 - accuracy: 0.9668 Epoch 70/120 963/963 [==============================] - 0s 6us/step - loss: 0.2581 - accuracy: 0.9678 Epoch 71/120 963/963 [==============================] - 0s 5us/step - loss: 0.2142 - accuracy: 0.9668 Epoch 72/120 963/963 [==============================] - 0s 6us/step - loss: 0.2435 - accuracy: 0.9688 Epoch 73/120 963/963 [==============================] - 0s 7us/step - loss: 0.2286 - accuracy: 0.9678 Epoch 74/120 963/963 [==============================] - 0s 7us/step - loss: 0.2239 - accuracy: 0.9688 Epoch 75/120 963/963 [==============================] - 0s 9us/step - loss: 0.2195 - accuracy: 0.9678 Epoch 76/120 963/963 [==============================] - 0s 6us/step - loss: 0.2286 - accuracy: 0.9668 Epoch 77/120 963/963 [==============================] - 0s 4us/step - loss: 0.2164 - accuracy: 0.9688 Epoch 78/120 963/963 [==============================] - 0s 6us/step - loss: 0.1984 - accuracy: 0.9699 Epoch 79/120 963/963 [==============================] - 0s 4us/step - loss: 0.2098 - accuracy: 0.9688 Epoch 80/120 963/963 [==============================] - 0s 6us/step - loss: 0.2048 - accuracy: 0.9678 Epoch 81/120 963/963 [==============================] - 0s 5us/step - loss: 0.2000 - accuracy: 0.9688 Epoch 82/120 963/963 [==============================] - 0s 7us/step - loss: 0.2426 - accuracy: 0.9688 Epoch 83/120 963/963 [==============================] - 0s 6us/step - loss: 0.1766 - accuracy: 0.9699 Epoch 84/120 963/963 [==============================] - 0s 9us/step - loss: 0.2383 - accuracy: 0.9699 Epoch 85/120 963/963 [==============================] - 0s 8us/step - loss: 0.2156 - accuracy: 0.9668 Epoch 86/120 963/963 [==============================] - 0s 5us/step - loss: 0.1976 - accuracy: 0.9699 Epoch 87/120 963/963 [==============================] - 0s 6us/step - loss: 0.2110 - accuracy: 0.9699 Epoch 88/120 963/963 [==============================] - 0s 4us/step - loss: 0.1927 - accuracy: 0.9699 Epoch 89/120 963/963 [==============================] - 0s 5us/step - loss: 0.1901 - accuracy: 0.9709 Epoch 90/120 963/963 [==============================] - 0s 5us/step - loss: 0.1750 - accuracy: 0.9709 Epoch 91/120 963/963 [==============================] - 0s 9us/step - loss: 0.2089 - accuracy: 0.9688 Epoch 92/120 963/963 [==============================] - 0s 6us/step - loss: 0.1750 - accuracy: 0.9709 Epoch 93/120 963/963 [==============================] - 0s 4us/step - loss: 0.1844 - accuracy: 0.9699 Epoch 94/120 963/963 [==============================] - 0s 9us/step - loss: 0.2020 - accuracy: 0.9699 Epoch 95/120 963/963 [==============================] - 0s 6us/step - loss: 0.1726 - accuracy: 0.9699 Epoch 96/120 963/963 [==============================] - 0s 7us/step - loss: 0.1751 - accuracy: 0.9709 Epoch 97/120 963/963 [==============================] - 0s 7us/step - loss: 0.1836 - accuracy: 0.9668 Epoch 98/120 963/963 [==============================] - 0s 6us/step - loss: 0.2005 - accuracy: 0.9720 Epoch 99/120 963/963 [==============================] - 0s 6us/step - loss: 0.1725 - accuracy: 0.9720 Epoch 100/120 963/963 [==============================] - 0s 4us/step - loss: 0.1525 - accuracy: 0.9699 Epoch 101/120 963/963 [==============================] - 0s 6us/step - loss: 0.1517 - accuracy: 0.9699 Epoch 102/120 963/963 [==============================] - 0s 10us/step - loss: 0.1666 - accuracy: 0.9720 Epoch 103/120 963/963 [==============================] - 0s 4us/step - loss: 0.1901 - accuracy: 0.9699 Epoch 104/120 963/963 [==============================] - 0s 9us/step - loss: 0.1541 - accuracy: 0.9709 Epoch 105/120 963/963 [==============================] - 0s 4us/step - loss: 0.1750 - accuracy: 0.9709 Epoch 106/120 963/963 [==============================] - 0s 9us/step - loss: 0.1667 - accuracy: 0.9720 Epoch 107/120 963/963 [==============================] - 0s 5us/step - loss: 0.1701 - accuracy: 0.9699 Epoch 108/120 963/963 [==============================] - 0s 5us/step - loss: 0.1425 - accuracy: 0.9720 Epoch 109/120 963/963 [==============================] - 0s 6us/step - loss: 0.1515 - accuracy: 0.9720 Epoch 110/120 963/963 [==============================] - 0s 4us/step - loss: 0.1829 - accuracy: 0.9709 Epoch 111/120 963/963 [==============================] - 0s 5us/step - loss: 0.1397 - accuracy: 0.9720 Epoch 112/120 963/963 [==============================] - 0s 6us/step - loss: 0.1761 - accuracy: 0.9709 Epoch 113/120 963/963 [==============================] - 0s 8us/step - loss: 0.1666 - accuracy: 0.9699 Epoch 114/120 963/963 [==============================] - 0s 5us/step - loss: 0.1418 - accuracy: 0.9720 Epoch 115/120 963/963 [==============================] - 0s 7us/step - loss: 0.1304 - accuracy: 0.9740 Epoch 116/120 963/963 [==============================] - 0s 6us/step - loss: 0.1526 - accuracy: 0.9699 Epoch 117/120 963/963 [==============================] - 0s 7us/step - loss: 0.1370 - accuracy: 0.9720 Epoch 118/120 963/963 [==============================] - 0s 6us/step - loss: 0.1285 - accuracy: 0.9709 Epoch 119/120 963/963 [==============================] - 0s 5us/step - loss: 0.1856 - accuracy: 0.9720 Epoch 120/120 963/963 [==============================] - 0s 6us/step - loss: 0.1403 - accuracy: 0.9751 632/632 [==============================] - 0s 182us/step 632/632 [==============================] - 0s 86us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 7us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 1us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 4us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 2us/step 632/632 [==============================] - 0s 3us/step Bin 1/9 Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 33.0s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.6min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 38.9s /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 2.2min finished
Epoch 1/50 1129/1129 [==============================] - 0s 158us/step - loss: 3.0641 - accuracy: 0.9415 Epoch 2/50 1129/1129 [==============================] - 0s 5us/step - loss: 2.7615 - accuracy: 0.9424 Epoch 3/50 1129/1129 [==============================] - 0s 5us/step - loss: 2.2815 - accuracy: 0.9362 Epoch 4/50 1129/1129 [==============================] - 0s 5us/step - loss: 2.0528 - accuracy: 0.9318 Epoch 5/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.7712 - accuracy: 0.9309 Epoch 6/50 1129/1129 [==============================] - 0s 4us/step - loss: 1.8465 - accuracy: 0.9318 Epoch 7/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.6641 - accuracy: 0.9247 Epoch 8/50 1129/1129 [==============================] - 0s 4us/step - loss: 1.5601 - accuracy: 0.9238 Epoch 9/50 1129/1129 [==============================] - 0s 4us/step - loss: 1.6996 - accuracy: 0.9265 Epoch 10/50 1129/1129 [==============================] - 0s 8us/step - loss: 1.5433 - accuracy: 0.9141 Epoch 11/50 1129/1129 [==============================] - 0s 6us/step - loss: 1.3532 - accuracy: 0.9159 Epoch 12/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.3604 - accuracy: 0.9123 Epoch 13/50 1129/1129 [==============================] - 0s 6us/step - loss: 1.5074 - accuracy: 0.8999 Epoch 14/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.2411 - accuracy: 0.9132 Epoch 15/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.1542 - accuracy: 0.9141 Epoch 16/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.2682 - accuracy: 0.8937 Epoch 17/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.1364 - accuracy: 0.9043 Epoch 18/50 1129/1129 [==============================] - 0s 4us/step - loss: 1.0896 - accuracy: 0.8937 Epoch 19/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.0320 - accuracy: 0.8990 Epoch 20/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.9384 - accuracy: 0.9035 Epoch 21/50 1129/1129 [==============================] - 0s 5us/step - loss: 1.0439 - accuracy: 0.9123 Epoch 22/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.9422 - accuracy: 0.8937 Epoch 23/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.8215 - accuracy: 0.9114 Epoch 24/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.9942 - accuracy: 0.9026 Epoch 25/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.8282 - accuracy: 0.9026 Epoch 26/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.8849 - accuracy: 0.9070 Epoch 27/50 1129/1129 [==============================] - 0s 6us/step - loss: 0.7643 - accuracy: 0.9132 Epoch 28/50 1129/1129 [==============================] - 0s 7us/step - loss: 0.8651 - accuracy: 0.9159 Epoch 29/50 1129/1129 [==============================] - 0s 7us/step - loss: 0.8678 - accuracy: 0.8981 Epoch 30/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.8356 - accuracy: 0.9114 Epoch 31/50 1129/1129 [==============================] - 0s 6us/step - loss: 0.6849 - accuracy: 0.9123 Epoch 32/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.7547 - accuracy: 0.9123 Epoch 33/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.6846 - accuracy: 0.9167 Epoch 34/50 1129/1129 [==============================] - 0s 6us/step - loss: 0.6532 - accuracy: 0.9256 Epoch 35/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.6772 - accuracy: 0.9105 Epoch 36/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.6499 - accuracy: 0.9185 Epoch 37/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.5897 - accuracy: 0.9203 Epoch 38/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.5930 - accuracy: 0.9247 Epoch 39/50 1129/1129 [==============================] - 0s 6us/step - loss: 0.5953 - accuracy: 0.9194 Epoch 40/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.5633 - accuracy: 0.9371 Epoch 41/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.5051 - accuracy: 0.9345 Epoch 42/50 1129/1129 [==============================] - 0s 6us/step - loss: 0.4850 - accuracy: 0.9318 Epoch 43/50 1129/1129 [==============================] - 0s 6us/step - loss: 0.4658 - accuracy: 0.9345 Epoch 44/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.4909 - accuracy: 0.9362 Epoch 45/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.4600 - accuracy: 0.9353 Epoch 46/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.4367 - accuracy: 0.9433 Epoch 47/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.4038 - accuracy: 0.9415 Epoch 48/50 1129/1129 [==============================] - 0s 5us/step - loss: 0.4375 - accuracy: 0.9539 Epoch 49/50 1129/1129 [==============================] - 0s 7us/step - loss: 0.3956 - accuracy: 0.9424 Epoch 50/50 1129/1129 [==============================] - 0s 4us/step - loss: 0.4847 - accuracy: 0.9415 740/740 [==============================] - 0s 157us/step 740/740 [==============================] - 0s 79us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 5us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 6us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 5us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 10us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 6us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 4us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 5us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 3us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step 740/740 [==============================] - 0s 2us/step Bin 2/9 Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 39.6s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.8min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 28.5s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.8min finished
Epoch 1/120 1315/1315 [==============================] - 0s 122us/step - loss: 1.9726 - accuracy: 0.8684 Epoch 2/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.9528 - accuracy: 0.8608 Epoch 3/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.8288 - accuracy: 0.8433 Epoch 4/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.8846 - accuracy: 0.8243 Epoch 5/120 1315/1315 [==============================] - 0s 6us/step - loss: 1.6292 - accuracy: 0.8183 Epoch 6/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.5646 - accuracy: 0.8015 Epoch 7/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.7086 - accuracy: 0.7909 Epoch 8/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.6252 - accuracy: 0.7856 Epoch 9/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.5111 - accuracy: 0.7894 Epoch 10/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.4095 - accuracy: 0.7711 Epoch 11/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.6750 - accuracy: 0.7795 Epoch 12/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.5045 - accuracy: 0.7650 Epoch 13/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.3283 - accuracy: 0.7802 Epoch 14/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.4035 - accuracy: 0.7605 Epoch 15/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.3679 - accuracy: 0.7658 Epoch 16/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.4980 - accuracy: 0.7589 Epoch 17/120 1315/1315 [==============================] - 0s 6us/step - loss: 1.3523 - accuracy: 0.7452 Epoch 18/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.2889 - accuracy: 0.7529 Epoch 19/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.1780 - accuracy: 0.7673 Epoch 20/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.2273 - accuracy: 0.7589 Epoch 21/120 1315/1315 [==============================] - 0s 3us/step - loss: 1.2082 - accuracy: 0.7559 Epoch 22/120 1315/1315 [==============================] - 0s 3us/step - loss: 1.3654 - accuracy: 0.7529 Epoch 23/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.2690 - accuracy: 0.7521 Epoch 24/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.2537 - accuracy: 0.7240 Epoch 25/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.3123 - accuracy: 0.7369 Epoch 26/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.2243 - accuracy: 0.7430 Epoch 27/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.1443 - accuracy: 0.7346 Epoch 28/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.3143 - accuracy: 0.7369 Epoch 29/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.1164 - accuracy: 0.7384 Epoch 30/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0593 - accuracy: 0.7422 Epoch 31/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0540 - accuracy: 0.7293 Epoch 32/120 1315/1315 [==============================] - 0s 3us/step - loss: 1.1596 - accuracy: 0.7141 Epoch 33/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.1038 - accuracy: 0.7255 Epoch 34/120 1315/1315 [==============================] - 0s 3us/step - loss: 1.1672 - accuracy: 0.7232 Epoch 35/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.1418 - accuracy: 0.7346 Epoch 36/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.2118 - accuracy: 0.7293 Epoch 37/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0790 - accuracy: 0.7179 Epoch 38/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0177 - accuracy: 0.7163 Epoch 39/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.0997 - accuracy: 0.7202 Epoch 40/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0551 - accuracy: 0.7232 Epoch 41/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0370 - accuracy: 0.7399 Epoch 42/120 1315/1315 [==============================] - 0s 3us/step - loss: 1.0522 - accuracy: 0.7346 Epoch 43/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0557 - accuracy: 0.7224 Epoch 44/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.1250 - accuracy: 0.7354 Epoch 45/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.0563 - accuracy: 0.7346 Epoch 46/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0050 - accuracy: 0.7110 Epoch 47/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0667 - accuracy: 0.7285 Epoch 48/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.9576 - accuracy: 0.7323 Epoch 49/120 1315/1315 [==============================] - 0s 7us/step - loss: 0.9660 - accuracy: 0.7376 Epoch 50/120 1315/1315 [==============================] - 0s 7us/step - loss: 1.0852 - accuracy: 0.7407 Epoch 51/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.9309 - accuracy: 0.7430 Epoch 52/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.0691 - accuracy: 0.7452 Epoch 53/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8782 - accuracy: 0.7589 Epoch 54/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.9115 - accuracy: 0.7376 Epoch 55/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.9617 - accuracy: 0.7354 Epoch 56/120 1315/1315 [==============================] - 0s 4us/step - loss: 1.0882 - accuracy: 0.7589 Epoch 57/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.9430 - accuracy: 0.7430 Epoch 58/120 1315/1315 [==============================] - 0s 5us/step - loss: 1.0898 - accuracy: 0.7399 Epoch 59/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.9226 - accuracy: 0.7392 Epoch 60/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.9232 - accuracy: 0.7490 Epoch 61/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8416 - accuracy: 0.7620 Epoch 62/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.9201 - accuracy: 0.7513 Epoch 63/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.9750 - accuracy: 0.7452 Epoch 64/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.9047 - accuracy: 0.7513 Epoch 65/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8322 - accuracy: 0.7696 Epoch 66/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8455 - accuracy: 0.7871 Epoch 67/120 1315/1315 [==============================] - 0s 6us/step - loss: 0.9004 - accuracy: 0.7605 Epoch 68/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.7805 - accuracy: 0.7749 Epoch 69/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.9288 - accuracy: 0.7627 Epoch 70/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.8406 - accuracy: 0.7726 Epoch 71/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.9745 - accuracy: 0.7597 Epoch 72/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.7628 - accuracy: 0.7749 Epoch 73/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.8488 - accuracy: 0.8008 Epoch 74/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8549 - accuracy: 0.7673 Epoch 75/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.7917 - accuracy: 0.7787 Epoch 76/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.8509 - accuracy: 0.7817 Epoch 77/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8479 - accuracy: 0.7932 Epoch 78/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8719 - accuracy: 0.7848 Epoch 79/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8638 - accuracy: 0.8023 Epoch 80/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8078 - accuracy: 0.7932 Epoch 81/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.8600 - accuracy: 0.7932 Epoch 82/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.7810 - accuracy: 0.8061 Epoch 83/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.8656 - accuracy: 0.7856 Epoch 84/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.6895 - accuracy: 0.8160 Epoch 85/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.7429 - accuracy: 0.8030 Epoch 86/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.7748 - accuracy: 0.8000 Epoch 87/120 1315/1315 [==============================] - 0s 7us/step - loss: 0.7473 - accuracy: 0.8213 Epoch 88/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.7045 - accuracy: 0.8236 Epoch 89/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.7073 - accuracy: 0.8297 Epoch 90/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.7923 - accuracy: 0.8221 Epoch 91/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.6710 - accuracy: 0.8266 Epoch 92/120 1315/1315 [==============================] - 0s 7us/step - loss: 0.7869 - accuracy: 0.8327 Epoch 93/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.6464 - accuracy: 0.8304 Epoch 94/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.7592 - accuracy: 0.8388 Epoch 95/120 1315/1315 [==============================] - 0s 7us/step - loss: 0.6744 - accuracy: 0.8342 Epoch 96/120 1315/1315 [==============================] - 0s 9us/step - loss: 0.7156 - accuracy: 0.8297 Epoch 97/120 1315/1315 [==============================] - 0s 6us/step - loss: 0.7087 - accuracy: 0.8297 Epoch 98/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.6387 - accuracy: 0.8380 Epoch 99/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.6948 - accuracy: 0.8433 Epoch 100/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.6542 - accuracy: 0.8441 Epoch 101/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.6208 - accuracy: 0.8335 Epoch 102/120 1315/1315 [==============================] - 0s 3us/step - loss: 0.5055 - accuracy: 0.8487 Epoch 103/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.6115 - accuracy: 0.8517 Epoch 104/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.7229 - accuracy: 0.8601 Epoch 105/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.6952 - accuracy: 0.8548 Epoch 106/120 1315/1315 [==============================] - 0s 3us/step - loss: 0.6155 - accuracy: 0.8548 Epoch 107/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.5861 - accuracy: 0.8494 Epoch 108/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.5980 - accuracy: 0.8821 Epoch 109/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.6196 - accuracy: 0.8646 Epoch 110/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.6033 - accuracy: 0.8471 Epoch 111/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.6641 - accuracy: 0.8510 Epoch 112/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.5729 - accuracy: 0.8738 Epoch 113/120 1315/1315 [==============================] - 0s 3us/step - loss: 0.5586 - accuracy: 0.8738 Epoch 114/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.6306 - accuracy: 0.8791 Epoch 115/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.6072 - accuracy: 0.8806 Epoch 116/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.6154 - accuracy: 0.8692 Epoch 117/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.5182 - accuracy: 0.8654 Epoch 118/120 1315/1315 [==============================] - 0s 5us/step - loss: 0.5642 - accuracy: 0.8669 Epoch 119/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.5801 - accuracy: 0.8768 Epoch 120/120 1315/1315 [==============================] - 0s 4us/step - loss: 0.5493 - accuracy: 0.8692 862/862 [==============================] - 0s 151us/step 862/862 [==============================] - 0s 73us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 4us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 4us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 5us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 5us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 4us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 3us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 2us/step 862/862 [==============================] - 0s 1us/step 862/862 [==============================] - 0s 2us/step Bin 3/9 Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 39.2s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.9min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 41.6s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.7min finished
Epoch 1/50 1515/1515 [==============================] - 0s 126us/step - loss: 2.3257 - accuracy: 0.6205 Epoch 2/50 1515/1515 [==============================] - 0s 3us/step - loss: 2.1981 - accuracy: 0.5901 Epoch 3/50 1515/1515 [==============================] - 0s 3us/step - loss: 2.2848 - accuracy: 0.5809 Epoch 4/50 1515/1515 [==============================] - 0s 3us/step - loss: 2.2798 - accuracy: 0.5782 Epoch 5/50 1515/1515 [==============================] - 0s 3us/step - loss: 2.1789 - accuracy: 0.5696 Epoch 6/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.9293 - accuracy: 0.5406 Epoch 7/50 1515/1515 [==============================] - 0s 4us/step - loss: 2.0066 - accuracy: 0.5300 Epoch 8/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.9036 - accuracy: 0.5195 Epoch 9/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.7940 - accuracy: 0.4977 Epoch 10/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.8128 - accuracy: 0.4799 Epoch 11/50 1515/1515 [==============================] - 0s 4us/step - loss: 2.0109 - accuracy: 0.4799 Epoch 12/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.9196 - accuracy: 0.4528 Epoch 13/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.8040 - accuracy: 0.4416 Epoch 14/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.6023 - accuracy: 0.4337 Epoch 15/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.6842 - accuracy: 0.4178 Epoch 16/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.7386 - accuracy: 0.4297 Epoch 17/50 1515/1515 [==============================] - 0s 2us/step - loss: 1.6337 - accuracy: 0.3954 Epoch 18/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.5213 - accuracy: 0.4073 Epoch 19/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.7138 - accuracy: 0.3782 Epoch 20/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.6560 - accuracy: 0.3756 Epoch 21/50 1515/1515 [==============================] - 0s 2us/step - loss: 1.6300 - accuracy: 0.3888 Epoch 22/50 1515/1515 [==============================] - 0s 5us/step - loss: 1.5431 - accuracy: 0.3776 Epoch 23/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.5532 - accuracy: 0.3888 Epoch 24/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.6103 - accuracy: 0.3683 Epoch 25/50 1515/1515 [==============================] - 0s 5us/step - loss: 1.5335 - accuracy: 0.3663 Epoch 26/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.5038 - accuracy: 0.3782 Epoch 27/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.5108 - accuracy: 0.3604 Epoch 28/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.4592 - accuracy: 0.3716 Epoch 29/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.5255 - accuracy: 0.3624 Epoch 30/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.5210 - accuracy: 0.3578 Epoch 31/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.4559 - accuracy: 0.3690 Epoch 32/50 1515/1515 [==============================] - 0s 2us/step - loss: 1.4456 - accuracy: 0.3644 Epoch 33/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.4281 - accuracy: 0.3611 Epoch 34/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.5933 - accuracy: 0.3842 Epoch 35/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.5144 - accuracy: 0.4020 Epoch 36/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.6753 - accuracy: 0.3815 Epoch 37/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.3587 - accuracy: 0.3855 Epoch 38/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.4865 - accuracy: 0.3914 Epoch 39/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.4376 - accuracy: 0.4007 Epoch 40/50 1515/1515 [==============================] - 0s 5us/step - loss: 1.4214 - accuracy: 0.4013 Epoch 41/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.4657 - accuracy: 0.3974 Epoch 42/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.4606 - accuracy: 0.4165 Epoch 43/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.4067 - accuracy: 0.4178 Epoch 44/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.4658 - accuracy: 0.4224 Epoch 45/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.3137 - accuracy: 0.4257 Epoch 46/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.3725 - accuracy: 0.4376 Epoch 47/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.3196 - accuracy: 0.4455 Epoch 48/50 1515/1515 [==============================] - 0s 3us/step - loss: 1.2792 - accuracy: 0.4462 Epoch 49/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.3431 - accuracy: 0.4686 Epoch 50/50 1515/1515 [==============================] - 0s 4us/step - loss: 1.3246 - accuracy: 0.4640 990/990 [==============================] - 0s 152us/step 990/990 [==============================] - 0s 59us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 5us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 5us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 4us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 5us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 4us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 4us/step 990/990 [==============================] - 0s 6us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 10us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 5us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 5us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 4us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 3us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 2us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step 990/990 [==============================] - 0s 1us/step Bin 4/9 Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 34.0s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.8min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 46.8s /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.9min finished
Epoch 1/50 1647/1647 [==============================] - 0s 120us/step - loss: 1.7036 - accuracy: 0.1882 Epoch 2/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.8015 - accuracy: 0.2301 Epoch 3/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.5982 - accuracy: 0.2240 Epoch 4/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.5306 - accuracy: 0.2708 Epoch 5/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.5559 - accuracy: 0.2939 Epoch 6/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.4834 - accuracy: 0.3382 Epoch 7/50 1647/1647 [==============================] - 0s 5us/step - loss: 1.4997 - accuracy: 0.3746 Epoch 8/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.4110 - accuracy: 0.3995 Epoch 9/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.4162 - accuracy: 0.4311 Epoch 10/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.4315 - accuracy: 0.4499 Epoch 11/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.4044 - accuracy: 0.4754 Epoch 12/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.4319 - accuracy: 0.4784 Epoch 13/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.3958 - accuracy: 0.4894 Epoch 14/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.2727 - accuracy: 0.5106 Epoch 15/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.2882 - accuracy: 0.5276 Epoch 16/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.3157 - accuracy: 0.5288 Epoch 17/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.2788 - accuracy: 0.5592 Epoch 18/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.2615 - accuracy: 0.5440 Epoch 19/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.2912 - accuracy: 0.5574 Epoch 20/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.2541 - accuracy: 0.5586 Epoch 21/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.2399 - accuracy: 0.5713 Epoch 22/50 1647/1647 [==============================] - 0s 2us/step - loss: 1.2273 - accuracy: 0.6041 Epoch 23/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.2071 - accuracy: 0.6011 Epoch 24/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.1832 - accuracy: 0.6035 Epoch 25/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.2422 - accuracy: 0.6035 Epoch 26/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.1005 - accuracy: 0.6260 Epoch 27/50 1647/1647 [==============================] - 0s 2us/step - loss: 1.0903 - accuracy: 0.6436 Epoch 28/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.1356 - accuracy: 0.6145 Epoch 29/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.1174 - accuracy: 0.6454 Epoch 30/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.1001 - accuracy: 0.6679 Epoch 31/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.0630 - accuracy: 0.6533 Epoch 32/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.0579 - accuracy: 0.6655 Epoch 33/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.0213 - accuracy: 0.6630 Epoch 34/50 1647/1647 [==============================] - 0s 2us/step - loss: 1.0117 - accuracy: 0.6733 Epoch 35/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.0771 - accuracy: 0.6806 Epoch 36/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.0848 - accuracy: 0.7007 Epoch 37/50 1647/1647 [==============================] - 0s 3us/step - loss: 0.9723 - accuracy: 0.6897 Epoch 38/50 1647/1647 [==============================] - 0s 3us/step - loss: 1.0162 - accuracy: 0.6995 Epoch 39/50 1647/1647 [==============================] - 0s 4us/step - loss: 1.0120 - accuracy: 0.7073 Epoch 40/50 1647/1647 [==============================] - 0s 4us/step - loss: 0.8541 - accuracy: 0.7098 Epoch 41/50 1647/1647 [==============================] - 0s 4us/step - loss: 0.8782 - accuracy: 0.7237 Epoch 42/50 1647/1647 [==============================] - 0s 4us/step - loss: 0.9040 - accuracy: 0.7158 Epoch 43/50 1647/1647 [==============================] - 0s 3us/step - loss: 0.8918 - accuracy: 0.7104 Epoch 44/50 1647/1647 [==============================] - 0s 3us/step - loss: 0.9119 - accuracy: 0.7165 Epoch 45/50 1647/1647 [==============================] - 0s 3us/step - loss: 0.8636 - accuracy: 0.7152 Epoch 46/50 1647/1647 [==============================] - 0s 4us/step - loss: 0.9599 - accuracy: 0.7420 Epoch 47/50 1647/1647 [==============================] - 0s 3us/step - loss: 0.8210 - accuracy: 0.7401 Epoch 48/50 1647/1647 [==============================] - 0s 4us/step - loss: 0.8420 - accuracy: 0.7371 Epoch 49/50 1647/1647 [==============================] - 0s 3us/step - loss: 0.8565 - accuracy: 0.7535 Epoch 50/50 1647/1647 [==============================] - 0s 6us/step - loss: 0.8027 - accuracy: 0.7523 1080/1080 [==============================] - 0s 157us/step 1080/1080 [==============================] - 0s 60us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 4us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 5us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 4us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 3us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 4us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 2us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step 1080/1080 [==============================] - 0s 1us/step Bin 5/9 Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 35.7s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.9min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 38.1s /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.9min finished
Epoch 1/50 1740/1740 [==============================] - 0s 119us/step - loss: 2.6140 - accuracy: 0.9649 Epoch 2/50 1740/1740 [==============================] - 0s 3us/step - loss: 2.3165 - accuracy: 0.9460 Epoch 3/50 1740/1740 [==============================] - 0s 5us/step - loss: 2.1365 - accuracy: 0.9236 Epoch 4/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.9331 - accuracy: 0.9172 Epoch 5/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.6876 - accuracy: 0.8879 Epoch 6/50 1740/1740 [==============================] - 0s 2us/step - loss: 1.6844 - accuracy: 0.8471 Epoch 7/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.5909 - accuracy: 0.8218 Epoch 8/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.3922 - accuracy: 0.7908 Epoch 9/50 1740/1740 [==============================] - 0s 4us/step - loss: 1.4389 - accuracy: 0.7517 Epoch 10/50 1740/1740 [==============================] - 0s 2us/step - loss: 1.4711 - accuracy: 0.7247 Epoch 11/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.3088 - accuracy: 0.6782 Epoch 12/50 1740/1740 [==============================] - 0s 4us/step - loss: 1.3839 - accuracy: 0.6707 Epoch 13/50 1740/1740 [==============================] - 0s 4us/step - loss: 1.3114 - accuracy: 0.6328 Epoch 14/50 1740/1740 [==============================] - 0s 2us/step - loss: 1.3355 - accuracy: 0.6098 Epoch 15/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.2487 - accuracy: 0.5713 Epoch 16/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.2755 - accuracy: 0.5874 Epoch 17/50 1740/1740 [==============================] - 0s 4us/step - loss: 1.2214 - accuracy: 0.5523 Epoch 18/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.1561 - accuracy: 0.5569 Epoch 19/50 1740/1740 [==============================] - 0s 2us/step - loss: 1.2965 - accuracy: 0.5500 Epoch 20/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.2291 - accuracy: 0.5580 Epoch 21/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.1934 - accuracy: 0.5356 Epoch 22/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.2114 - accuracy: 0.5322 Epoch 23/50 1740/1740 [==============================] - 0s 2us/step - loss: 1.1470 - accuracy: 0.5471 Epoch 24/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.1923 - accuracy: 0.5471 Epoch 25/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.1452 - accuracy: 0.5466 Epoch 26/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.1140 - accuracy: 0.5489 Epoch 27/50 1740/1740 [==============================] - 0s 2us/step - loss: 1.1884 - accuracy: 0.5626 Epoch 28/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.0757 - accuracy: 0.5575 Epoch 29/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.1340 - accuracy: 0.5713 Epoch 30/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.1502 - accuracy: 0.5724 Epoch 31/50 1740/1740 [==============================] - 0s 2us/step - loss: 1.0238 - accuracy: 0.5828 Epoch 32/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.0607 - accuracy: 0.5983 Epoch 33/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.0580 - accuracy: 0.6006 Epoch 34/50 1740/1740 [==============================] - 0s 4us/step - loss: 1.0122 - accuracy: 0.6218 Epoch 35/50 1740/1740 [==============================] - 0s 5us/step - loss: 1.0341 - accuracy: 0.6345 Epoch 36/50 1740/1740 [==============================] - 0s 5us/step - loss: 1.0254 - accuracy: 0.6224 Epoch 37/50 1740/1740 [==============================] - 0s 4us/step - loss: 1.0323 - accuracy: 0.6460 Epoch 38/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.0284 - accuracy: 0.6402 Epoch 39/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.0111 - accuracy: 0.6615 Epoch 40/50 1740/1740 [==============================] - 0s 4us/step - loss: 0.9882 - accuracy: 0.6695 Epoch 41/50 1740/1740 [==============================] - 0s 3us/step - loss: 0.9892 - accuracy: 0.6747 Epoch 42/50 1740/1740 [==============================] - 0s 4us/step - loss: 0.9491 - accuracy: 0.6799 Epoch 43/50 1740/1740 [==============================] - 0s 3us/step - loss: 0.9809 - accuracy: 0.6966 Epoch 44/50 1740/1740 [==============================] - 0s 3us/step - loss: 0.9809 - accuracy: 0.7086 Epoch 45/50 1740/1740 [==============================] - 0s 3us/step - loss: 1.0039 - accuracy: 0.7178 Epoch 46/50 1740/1740 [==============================] - 0s 3us/step - loss: 0.8575 - accuracy: 0.7264 Epoch 47/50 1740/1740 [==============================] - 0s 3us/step - loss: 0.9967 - accuracy: 0.7075 Epoch 48/50 1740/1740 [==============================] - 0s 3us/step - loss: 0.9247 - accuracy: 0.7149 Epoch 49/50 1740/1740 [==============================] - 0s 5us/step - loss: 0.8288 - accuracy: 0.7316 Epoch 50/50 1740/1740 [==============================] - 0s 4us/step - loss: 0.8947 - accuracy: 0.7420 1142/1142 [==============================] - 0s 166us/step 1142/1142 [==============================] - 0s 61us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 5us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 4us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 5us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 5us/step 1142/1142 [==============================] - 0s 9us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 3us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 4us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 2us/step 1142/1142 [==============================] - 0s 1us/step 1142/1142 [==============================] - 0s 1us/step Bin 6/9 Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 37.9s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.9min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 28.9s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.9min finished
Epoch 1/50 1797/1797 [==============================] - 0s 106us/step - loss: 1.6636 - accuracy: 0.3817 Epoch 2/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.6957 - accuracy: 0.3728 Epoch 3/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.6671 - accuracy: 0.3623 Epoch 4/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.6823 - accuracy: 0.3656 Epoch 5/50 1797/1797 [==============================] - 0s 2us/step - loss: 1.5901 - accuracy: 0.3450 Epoch 6/50 1797/1797 [==============================] - 0s 5us/step - loss: 1.5881 - accuracy: 0.3461 Epoch 7/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5865 - accuracy: 0.3322 Epoch 8/50 1797/1797 [==============================] - 0s 2us/step - loss: 1.5707 - accuracy: 0.3333 Epoch 9/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5533 - accuracy: 0.3344 Epoch 10/50 1797/1797 [==============================] - 0s 2us/step - loss: 1.5549 - accuracy: 0.3261 Epoch 11/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.5364 - accuracy: 0.3378 Epoch 12/50 1797/1797 [==============================] - 0s 2us/step - loss: 1.5968 - accuracy: 0.3239 Epoch 13/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5854 - accuracy: 0.3133 Epoch 14/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5456 - accuracy: 0.3283 Epoch 15/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5172 - accuracy: 0.3172 Epoch 16/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5201 - accuracy: 0.3122 Epoch 17/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4962 - accuracy: 0.3322 Epoch 18/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.5633 - accuracy: 0.3250 Epoch 19/50 1797/1797 [==============================] - 0s 2us/step - loss: 1.5797 - accuracy: 0.3200 Epoch 20/50 1797/1797 [==============================] - 0s 2us/step - loss: 1.5368 - accuracy: 0.3088 Epoch 21/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.5079 - accuracy: 0.2866 Epoch 22/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5226 - accuracy: 0.3166 Epoch 23/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.4959 - accuracy: 0.3038 Epoch 24/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5585 - accuracy: 0.3127 Epoch 25/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5279 - accuracy: 0.3044 Epoch 26/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.4928 - accuracy: 0.2988 Epoch 27/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5452 - accuracy: 0.3011 Epoch 28/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4847 - accuracy: 0.3050 Epoch 29/50 1797/1797 [==============================] - 0s 2us/step - loss: 1.4995 - accuracy: 0.3144 Epoch 30/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4467 - accuracy: 0.3161 Epoch 31/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4585 - accuracy: 0.2927 Epoch 32/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4259 - accuracy: 0.3228 Epoch 33/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.5189 - accuracy: 0.3205 Epoch 34/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.3982 - accuracy: 0.3088 Epoch 35/50 1797/1797 [==============================] - 0s 7us/step - loss: 1.4310 - accuracy: 0.3155 Epoch 36/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4588 - accuracy: 0.3306 Epoch 37/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.4525 - accuracy: 0.3189 Epoch 38/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4791 - accuracy: 0.3111 Epoch 39/50 1797/1797 [==============================] - 0s 5us/step - loss: 1.4492 - accuracy: 0.3061 Epoch 40/50 1797/1797 [==============================] - 0s 2us/step - loss: 1.4550 - accuracy: 0.3161 Epoch 41/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4654 - accuracy: 0.3111 Epoch 42/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.4255 - accuracy: 0.3250 Epoch 43/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4584 - accuracy: 0.3166 Epoch 44/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4367 - accuracy: 0.3144 Epoch 45/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4764 - accuracy: 0.3244 Epoch 46/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.4119 - accuracy: 0.3294 Epoch 47/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4597 - accuracy: 0.3406 Epoch 48/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4872 - accuracy: 0.3328 Epoch 49/50 1797/1797 [==============================] - 0s 4us/step - loss: 1.4482 - accuracy: 0.3306 Epoch 50/50 1797/1797 [==============================] - 0s 3us/step - loss: 1.4349 - accuracy: 0.3367 1180/1180 [==============================] - 0s 175us/step 1180/1180 [==============================] - 0s 63us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 4us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 4us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 3us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 2us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 1us/step 1180/1180 [==============================] - 0s 2us/step Bin 7/9 Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 40.4s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 2.0min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 30.8s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.5min finished
Epoch 1/120 1877/1877 [==============================] - 0s 123us/step - loss: 1.9145 - accuracy: 0.4736 Epoch 2/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.7943 - accuracy: 0.4534 Epoch 3/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.7818 - accuracy: 0.4401 Epoch 4/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.8733 - accuracy: 0.4518 Epoch 5/120 1877/1877 [==============================] - 0s 7us/step - loss: 1.8866 - accuracy: 0.4411 Epoch 6/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.7755 - accuracy: 0.4385 Epoch 7/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.6379 - accuracy: 0.4214 Epoch 8/120 1877/1877 [==============================] - 0s 6us/step - loss: 1.6625 - accuracy: 0.4134 Epoch 9/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.5790 - accuracy: 0.4230 Epoch 10/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.6215 - accuracy: 0.4177 Epoch 11/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.6175 - accuracy: 0.3868 Epoch 12/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.6539 - accuracy: 0.4150 Epoch 13/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.5426 - accuracy: 0.4108 Epoch 14/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.4648 - accuracy: 0.4065 Epoch 15/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.3712 - accuracy: 0.4044 Epoch 16/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.4611 - accuracy: 0.4049 Epoch 17/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.4080 - accuracy: 0.4076 Epoch 18/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.3363 - accuracy: 0.4347 Epoch 19/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.4893 - accuracy: 0.4150 Epoch 20/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.3603 - accuracy: 0.4433 Epoch 21/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.3394 - accuracy: 0.4406 Epoch 22/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.4006 - accuracy: 0.4475 Epoch 23/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.3606 - accuracy: 0.4475 Epoch 24/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.4595 - accuracy: 0.4544 Epoch 25/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.3847 - accuracy: 0.4816 Epoch 26/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.3366 - accuracy: 0.4896 Epoch 27/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.4204 - accuracy: 0.4838 Epoch 28/120 1877/1877 [==============================] - 0s 6us/step - loss: 1.3653 - accuracy: 0.4955 Epoch 29/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.2152 - accuracy: 0.5189 Epoch 30/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.4064 - accuracy: 0.5205 Epoch 31/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.3928 - accuracy: 0.5194 Epoch 32/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.2309 - accuracy: 0.5381 Epoch 33/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.2296 - accuracy: 0.5322 Epoch 34/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.2496 - accuracy: 0.5434 Epoch 35/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.2244 - accuracy: 0.5450 Epoch 36/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.2260 - accuracy: 0.5482 Epoch 37/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.2540 - accuracy: 0.5456 Epoch 38/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.2749 - accuracy: 0.5610 Epoch 39/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.2326 - accuracy: 0.5690 Epoch 40/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.1596 - accuracy: 0.5733 Epoch 41/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.2748 - accuracy: 0.5759 Epoch 42/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.1681 - accuracy: 0.5919 Epoch 43/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.2251 - accuracy: 0.5866 Epoch 44/120 1877/1877 [==============================] - 0s 6us/step - loss: 1.1711 - accuracy: 0.6031 Epoch 45/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.2164 - accuracy: 0.5898 Epoch 46/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.1606 - accuracy: 0.5930 Epoch 47/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.1027 - accuracy: 0.5978 Epoch 48/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.1597 - accuracy: 0.6074 Epoch 49/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.1550 - accuracy: 0.6159 Epoch 50/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.1119 - accuracy: 0.6207 Epoch 51/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.1166 - accuracy: 0.6265 Epoch 52/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.1384 - accuracy: 0.6169 Epoch 53/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.0576 - accuracy: 0.6420 Epoch 54/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.1095 - accuracy: 0.6265 Epoch 55/120 1877/1877 [==============================] - 0s 7us/step - loss: 1.1026 - accuracy: 0.6393 Epoch 56/120 1877/1877 [==============================] - 0s 6us/step - loss: 1.0460 - accuracy: 0.6420 Epoch 57/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.1917 - accuracy: 0.6335 Epoch 58/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.0184 - accuracy: 0.6457 Epoch 59/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0816 - accuracy: 0.6484 Epoch 60/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.1086 - accuracy: 0.6590 Epoch 61/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.0179 - accuracy: 0.6670 Epoch 62/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.0803 - accuracy: 0.6532 Epoch 63/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.0604 - accuracy: 0.6644 Epoch 64/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0530 - accuracy: 0.6489 Epoch 65/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0361 - accuracy: 0.6739 Epoch 66/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.0261 - accuracy: 0.6580 Epoch 67/120 1877/1877 [==============================] - 0s 6us/step - loss: 1.0516 - accuracy: 0.6574 Epoch 68/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0511 - accuracy: 0.6777 Epoch 69/120 1877/1877 [==============================] - 0s 5us/step - loss: 1.0122 - accuracy: 0.6723 Epoch 70/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.9824 - accuracy: 0.6750 Epoch 71/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0845 - accuracy: 0.6665 Epoch 72/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0802 - accuracy: 0.6660 Epoch 73/120 1877/1877 [==============================] - 0s 6us/step - loss: 1.0549 - accuracy: 0.6670 Epoch 74/120 1877/1877 [==============================] - 0s 6us/step - loss: 1.0628 - accuracy: 0.6771 Epoch 75/120 1877/1877 [==============================] - 0s 3us/step - loss: 0.9402 - accuracy: 0.6782 Epoch 76/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.9824 - accuracy: 0.6713 Epoch 77/120 1877/1877 [==============================] - 0s 6us/step - loss: 0.9808 - accuracy: 0.6825 Epoch 78/120 1877/1877 [==============================] - 0s 3us/step - loss: 1.0208 - accuracy: 0.6846 Epoch 79/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.9655 - accuracy: 0.7048 Epoch 80/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.9123 - accuracy: 0.6947 Epoch 81/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0636 - accuracy: 0.6862 Epoch 82/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.9109 - accuracy: 0.6990 Epoch 83/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8675 - accuracy: 0.7059 Epoch 84/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0216 - accuracy: 0.7032 Epoch 85/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.9756 - accuracy: 0.6937 Epoch 86/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8948 - accuracy: 0.6995 Epoch 87/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0152 - accuracy: 0.7006 Epoch 88/120 1877/1877 [==============================] - 0s 3us/step - loss: 0.9462 - accuracy: 0.7086 Epoch 89/120 1877/1877 [==============================] - 0s 6us/step - loss: 0.8850 - accuracy: 0.7017 Epoch 90/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.9584 - accuracy: 0.6990 Epoch 91/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8392 - accuracy: 0.7134 Epoch 92/120 1877/1877 [==============================] - 0s 4us/step - loss: 1.0084 - accuracy: 0.7203 Epoch 93/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.9154 - accuracy: 0.7118 Epoch 94/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.9477 - accuracy: 0.7118 Epoch 95/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.9117 - accuracy: 0.7107 Epoch 96/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8968 - accuracy: 0.7091 Epoch 97/120 1877/1877 [==============================] - 0s 6us/step - loss: 0.9248 - accuracy: 0.7107 Epoch 98/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.8517 - accuracy: 0.7288 Epoch 99/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.7995 - accuracy: 0.7171 Epoch 100/120 1877/1877 [==============================] - 0s 6us/step - loss: 0.9657 - accuracy: 0.7283 Epoch 101/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8861 - accuracy: 0.7150 Epoch 102/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8918 - accuracy: 0.7230 Epoch 103/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8798 - accuracy: 0.7251 Epoch 104/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.9687 - accuracy: 0.7288 Epoch 105/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8525 - accuracy: 0.7427 Epoch 106/120 1877/1877 [==============================] - 0s 3us/step - loss: 0.8784 - accuracy: 0.7389 Epoch 107/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.8279 - accuracy: 0.7352 Epoch 108/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8743 - accuracy: 0.7389 Epoch 109/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.7991 - accuracy: 0.7357 Epoch 110/120 1877/1877 [==============================] - 0s 3us/step - loss: 0.8852 - accuracy: 0.7389 Epoch 111/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.8690 - accuracy: 0.7421 Epoch 112/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.7951 - accuracy: 0.7640 Epoch 113/120 1877/1877 [==============================] - 0s 6us/step - loss: 0.7994 - accuracy: 0.7507 Epoch 114/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.8385 - accuracy: 0.7555 Epoch 115/120 1877/1877 [==============================] - 0s 7us/step - loss: 0.7927 - accuracy: 0.7576 Epoch 116/120 1877/1877 [==============================] - 0s 5us/step - loss: 0.8142 - accuracy: 0.7576 Epoch 117/120 1877/1877 [==============================] - 0s 7us/step - loss: 0.7882 - accuracy: 0.7672 Epoch 118/120 1877/1877 [==============================] - 0s 7us/step - loss: 0.7836 - accuracy: 0.7624 Epoch 119/120 1877/1877 [==============================] - 0s 3us/step - loss: 0.8947 - accuracy: 0.7672 Epoch 120/120 1877/1877 [==============================] - 0s 4us/step - loss: 0.7601 - accuracy: 0.7832 1230/1230 [==============================] - 0s 185us/step 1230/1230 [==============================] - 0s 72us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 6us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 4us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 4us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 4us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 4us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 4us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 3us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 5us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 4us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 2us/step 1230/1230 [==============================] - 0s 1us/step 1230/1230 [==============================] - 0s 1us/step Bin 8/9 Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 40.2s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 2.0min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 49.3s /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 2.1min finished
Epoch 1/50 1947/1947 [==============================] - 0s 103us/step - loss: 1.6263 - accuracy: 0.7334 Epoch 2/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.4918 - accuracy: 0.7042 Epoch 3/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.4976 - accuracy: 0.6877 Epoch 4/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.4505 - accuracy: 0.7093 Epoch 5/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.4397 - accuracy: 0.7067 Epoch 6/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.4013 - accuracy: 0.6739 Epoch 7/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.4342 - accuracy: 0.6708 Epoch 8/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.4044 - accuracy: 0.6692 Epoch 9/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.4508 - accuracy: 0.6502 Epoch 10/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.3653 - accuracy: 0.6466 Epoch 11/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.3806 - accuracy: 0.6210 Epoch 12/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.3152 - accuracy: 0.6225 Epoch 13/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.3845 - accuracy: 0.6456 Epoch 14/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.3584 - accuracy: 0.6369 Epoch 15/50 1947/1947 [==============================] - 0s 3us/step - loss: 1.2980 - accuracy: 0.6343 Epoch 16/50 1947/1947 [==============================] - 0s 6us/step - loss: 1.3487 - accuracy: 0.6148 Epoch 17/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.2890 - accuracy: 0.6220 Epoch 18/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.3038 - accuracy: 0.6143 Epoch 19/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.2465 - accuracy: 0.6246 Epoch 20/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.2825 - accuracy: 0.6246 Epoch 21/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.2541 - accuracy: 0.6225 Epoch 22/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.2718 - accuracy: 0.6199 Epoch 23/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.2984 - accuracy: 0.6143 Epoch 24/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.2347 - accuracy: 0.6199 Epoch 25/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.2553 - accuracy: 0.6240 Epoch 26/50 1947/1947 [==============================] - 0s 6us/step - loss: 1.2501 - accuracy: 0.6040 Epoch 27/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.2296 - accuracy: 0.6276 Epoch 28/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.2140 - accuracy: 0.6287 Epoch 29/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.1807 - accuracy: 0.6287 Epoch 30/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.1933 - accuracy: 0.6353 Epoch 31/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.1660 - accuracy: 0.6297 Epoch 32/50 1947/1947 [==============================] - 0s 6us/step - loss: 1.2195 - accuracy: 0.6133 Epoch 33/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.1398 - accuracy: 0.6266 Epoch 34/50 1947/1947 [==============================] - 0s 6us/step - loss: 1.1925 - accuracy: 0.6348 Epoch 35/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.1371 - accuracy: 0.6102 Epoch 36/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.2046 - accuracy: 0.6174 Epoch 37/50 1947/1947 [==============================] - 0s 3us/step - loss: 1.1236 - accuracy: 0.6338 Epoch 38/50 1947/1947 [==============================] - 0s 3us/step - loss: 1.1853 - accuracy: 0.6276 Epoch 39/50 1947/1947 [==============================] - 0s 6us/step - loss: 1.1408 - accuracy: 0.6343 Epoch 40/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.1307 - accuracy: 0.6400 Epoch 41/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.1034 - accuracy: 0.6271 Epoch 42/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.1303 - accuracy: 0.6420 Epoch 43/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.1324 - accuracy: 0.6333 Epoch 44/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.0864 - accuracy: 0.6410 Epoch 45/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.0796 - accuracy: 0.6471 Epoch 46/50 1947/1947 [==============================] - 0s 6us/step - loss: 1.0915 - accuracy: 0.6338 Epoch 47/50 1947/1947 [==============================] - 0s 5us/step - loss: 1.1022 - accuracy: 0.6471 Epoch 48/50 1947/1947 [==============================] - 0s 6us/step - loss: 1.0569 - accuracy: 0.6425 Epoch 49/50 1947/1947 [==============================] - 0s 4us/step - loss: 1.1022 - accuracy: 0.6492 Epoch 50/50 1947/1947 [==============================] - 0s 6us/step - loss: 1.0624 - accuracy: 0.6420 1280/1280 [==============================] - 0s 232us/step 1280/1280 [==============================] - 0s 68us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 4us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 3us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 3us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 4us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 3us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 3us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 2us/step 1280/1280 [==============================] - 0s 1us/step 1280/1280 [==============================] - 0s 2us/step Bin 9/9 Finished all bins
After the prediction, we want to see the performance of each predictor. Since the data is sparse in the bins, the predictors are a bit worse than the main predictor for all the data, especially for some periods.
# Plotting the ROC curves in plotly subplots
fig = make_subplots(rows=3, cols=3, start_cell="top-left", x_title='False positive rate', y_title='True positive rate',
subplot_titles=tuple(periods))
for it in range(9):
# Calculate roc_curves
fpr_rf_change, tpr_rf_change, thr_rf_change = roc_curve(rf_predict_bins[it].Label, rf_predict_bins[it].Predicted)
fpr_mlp_change, tpr_mlp_change, thr_mlp_change = roc_curve(mlp_predict_bins[it].Label, mlp_predict_bins[it].Predicted)
# Calculate AUC scores
auc_rf_change = auc(fpr_rf_change, tpr_rf_change)
auc_mlp_change = auc(fpr_mlp_change, tpr_mlp_change)
# Create figure
fig.add_trace(go.Scatter(x=fpr_rf_change, y=tpr_rf_change, name='Random Forest (AUC = {:.3}'.format(auc_rf_change), mode='lines'),
row=(it//3)+1, col=(it%3)+1)
fig.add_trace(go.Scatter(x=fpr_mlp_change, y=tpr_mlp_change, name='Multi Layer Perceptron (AUC = {:.3}'.format(auc_mlp_change), mode='lines'),
row=(it//3)+1, col=(it%3)+1)
fig.add_shape(type='line', line=dict(dash='dash'), x0=0, x1=1, y0=0, y1=1, row=(it//3)+1, col=(it%3)+1)
fig.update_layout(height=1000, width=1400, title_text="ROC curves for civil war onset in each period of 15 years",title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/roc_all.html", 'w') as file:
file.write(html)
And now we can finally plot the importance features variation along the years. In the first plot, we can see the feature importance on a linear scale, including negative values. This gives an idea on how reliable the feature importances for each bins are. The poor performance models will tend to have less reliable feature importances, and therefore have a lot of negative feature importances. Je sais pas si on met ce plot dans la datastory. The second plot is on a logarithmic scale. This is used to compare all the feature importances. We are not interested in the negative ones, since it only indicates the model is not very good.
# Feature importances plot with linear y scale to see how negative some values are
fig = px.bar(all_importances, x="Names", y="Scores", animation_frame='period', color="Model",
range_y=[-0.1, 0.1])
fig.update_layout(title_text="Permutation scores for civil war onset in different periods",title_x=0)
fig["layout"].pop("updatemenus")
fig.update_xaxes(tickangle=45)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/imp_slider.html", 'w') as file:
file.write(html)
# Feature importances plot with log y axis
fig = px.bar(all_importances, x="Names", y="Scores", animation_frame='period', color="Model",
log_y=True, range_y=[0.0001, 0.6],
)
fig.update_layout(title_text="Permutation scores for civil war onset in different periods (log)",title_x=0)
fig["layout"].pop("updatemenus")
fig.update_xaxes(tickangle=45)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/imp_slider_log.html", 'w') as file:
file.write(html)
In the previous analysis, by making slices of 15 years, we are imposing a period on which there could be a similarity in the feature importance. Now the idea is to cluster the events using the features in order to see if it gives rise to arbitrary periods where the features are similarly important.
We will select the important features found in the analysis before, in order to permit temporally significant clustering. See below the selected top 20 features. Since the Random Forest models are generally better, we will take all the features which have a permutation importance higher than 0.005 for the Random Forest model. We will add to this the top features of the Multilayer Perceptron models which were not top features in the Random Forest model to complete to 20 features.
df_onset.head()
| warstds | anoc | ager | autonomy | avgnabo | dem | dlang | drace | drel | ef | gdpgrowth | illiteracy | infant | inst | inst3 | life | lmtnest | milper | nat_war | ncontig | nwstate | oil | plural | plurrel | pol4sq | popdense | relfrac | seceduc | second | sxpsq | tnatwar | trade | warhist | xconst | lpopns | ln_gdpen | proxregc | partfree | decade1 | regd4_alt | etdo4590 | geo1 | presi | parreg | geo34 | year | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 0 | 34.461765 | 0.005151 | 0.432955 | 0 | 70.0 | 0.0 | 20.0 | 0.750797 | 0.022562 | 34.020639 | 68.655361 | 1 | 0.120897 | 61.348104 | 4.198705 | 121.087366 | 0 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | 61.493014 | 118.554791 | 0.2718 | 43.770298 | 0.253 | 0.052989 | 0.443259 | 72.881375 | 0 | 3.995912 | 16.094110 | 0.851709 | 0.143299 | 0 | 0 | -0.413956 | 1.0 | 0.0 | 0 | 3.835219 | 0.0 | 1945 |
| 1 | 0 | 0 | 34.346348 | 0.000000 | 0.045052 | 0 | 70.0 | 0.0 | 20.0 | 0.750797 | 0.022447 | 34.129908 | 68.918002 | 0 | 0.000000 | 61.297733 | 4.198705 | 121.885359 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | 100.000000 | 117.756342 | 0.2718 | 43.588363 | 0.253 | 0.052663 | 1.000000 | 72.900089 | 0 | 1.000000 | 16.116295 | -1.639897 | 1.000000 | 0 | 0 | -3.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1946 |
| 2 | 0 | 0 | 77.000000 | 0.000000 | 0.030034 | 0 | 70.0 | 0.0 | 20.0 | 0.750797 | 0.022372 | 34.183272 | 69.017545 | 0 | 0.000000 | 61.285176 | 4.198705 | 122.780608 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | 100.000000 | 118.280656 | 0.2718 | 43.538181 | 0.253 | 0.052891 | 2.000000 | 72.962880 | 0 | 1.000000 | 16.138290 | -1.629641 | 1.000000 | 0 | 0 | -3.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1947 |
| 3 | 0 | 0 | 78.000000 | 0.000000 | 0.022526 | 0 | 70.0 | 0.0 | 20.0 | 0.750797 | 0.022239 | 34.234445 | 69.126788 | 0 | 0.000000 | 61.252967 | 4.198705 | 118.256427 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | 100.000000 | 118.325869 | 0.2718 | 43.490005 | 0.253 | 0.052902 | 2.000000 | 73.102449 | 0 | 1.000000 | 16.252539 | -1.639897 | 1.000000 | 0 | 0 | -3.500000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1948 |
| 4 | 0 | 0 | 79.000000 | 0.000000 | 0.022526 | 0 | 70.0 | 0.0 | 20.0 | 0.750797 | 0.022462 | 34.164099 | 68.960291 | 0 | 0.000000 | 61.301547 | 4.198705 | 122.245074 | 1 | 0.0 | 0.0 | 0 | 0.38 | 84.0 | 100.000000 | 118.312296 | 0.2718 | 43.602238 | 0.253 | 0.052706 | 2.000000 | 72.850389 | 0 | 1.000000 | 16.270645 | -1.398367 | 1.000000 | 0 | 0 | 2.000000 | 1.0 | 0.0 | 0 | 4.000000 | 0.0 | 1949 |
# Finding top important features for the clustering
top_score_RF = 0.005
top_score_MLP = 0.02
top_nb = 20
topnbfeat_binsRF = all_importances[all_importances['Model'] == 'Random Forest'].sort_values('Scores',ascending=False)['Names'].unique()[:top_nb]
topimpfeat_binsRF = all_importances[all_importances['Model'] == 'Random Forest'].query('Scores > {}'.format(top_score_RF))['Names'].unique()
topnbfeat_binsMLP = all_importances[all_importances['Model'] == 'Multilayer Perceptron'].sort_values('Scores',ascending=False)['Names'].unique()[:top_nb]
topimpfeat_binsMLP = all_importances[all_importances['Model'] == 'Multilayer Perceptron'].query('Scores > {}'.format(top_score_MLP))['Names'].unique()
# Select the top features
top_feat_bins = list(pd.DataFrame({'Names':np.concatenate([topimpfeat_binsRF, topnbfeat_binsMLP])})['Names'].unique()[:20])
print('These are the selected top 20 features: ')
print(top_feat_bins)
These are the selected top 20 features: ['illiteracy', 'infant', 'sxpsq', 'trade', 'gdpgrowth', 'dlang', 'life', 'milper', 'popdense', 'regd4_alt', 'xconst', 'autonomy', 'inst3', 'nwstate', 'lpopns', 'seceduc', 'etdo4590', 'inst', 'warhist', 'ln_gdpen']
Here we want to see which features are binary. For the clustering, the continuous features will be normalized, and the binary features will be kept as they are. For this we inspect the following variables, suspected to be binary.
df_onset.loc[:,['warhist','nwstate','ncontig','ager','nat_war','oil','partfree','decade1','presi','etdo4590','dem','anoc']].describe()
| warhist | nwstate | ncontig | ager | nat_war | oil | partfree | decade1 | presi | etdo4590 | dem | anoc | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| count | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 | 7140.000000 |
| mean | 0.171008 | 0.028103 | 0.175304 | 34.082504 | 0.371569 | 0.118347 | 0.142717 | 0.163305 | 0.093838 | 0.470050 | 0.301120 | 0.202381 |
| std | 0.376543 | 0.159095 | 0.363599 | 32.792923 | 0.483258 | 0.323042 | 0.349809 | 0.369670 | 0.291623 | 0.435135 | 0.458777 | 0.401803 |
| min | 0.000000 | 0.000000 | 0.000000 | 1.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
| 25% | 0.000000 | 0.000000 | 0.000000 | 9.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
| 50% | 0.000000 | 0.000000 | 0.000000 | 23.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.452067 | 0.000000 | 0.000000 |
| 75% | 0.000000 | 0.000000 | 0.154555 | 45.000000 | 1.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 1.000000 | 1.000000 | 0.000000 |
| max | 1.000000 | 1.000000 | 1.000000 | 130.000000 | 1.000000 | 1.000000 | 1.000000 | 1.000000 | 1.000000 | 1.000000 | 1.000000 | 1.000000 |
In this part, we define the features to keep, the binary features and we scale the continuous features to prepare the dataset for clustering.
# Selecting the features which are important in the last analysis
non_top_feat = list(df_onset.columns.drop(top_feat_bins))
corrupt_feat = ['decade1', 'year', 'warstds'] # add inst ?
year_clust = df_onset.drop(index=df_onset[df_onset['warstds']==0].index)[['year']]
X_clust = df_onset.drop(columns=non_top_feat + corrupt_feat, index=df_onset[df_onset['warstds']==0].index )
# first scale the data, except binary data
bin_vars = ['warhist','geo1','geo34','anoc','nwstate','ncontig','dem','nat_war','oil','partfree','decade1','presi']
vars_to_drop = [var for var in top_feat_bins if var in bin_vars]
num_vars = X_clust.columns.drop(vars_to_drop)
scaled_vars = StandardScaler().fit_transform(X_clust[num_vars].values)
X_clust[num_vars] = scaled_vars
In order to reduce the dimensionality, and to get better clustering, we will apply Principal component analysis, and keep 90% of the explained variance. This reduces the number of components to 12 or 13 à vérifier.
# PCA
keep_exp_var = 0.9
# Find the number of components to keep 90% of explained variance
X_pca = PCA().fit(X_clust)
exvar = X_pca.explained_variance_ratio_.cumsum()
nb_comp = np.count_nonzero(exvar < keep_exp_var) + 1
X_clust_red = PCA(n_components=nb_comp).fit_transform(X_clust)
We will firstly use the OPTICS algorithm, which is a variation of the DBSCAN algorithm, which chooses the epsilon parameter automatically, We will use it because of its small number of hyperparameters and ability to cluster non globular clusters. We should choose an appropriate distance metric, it seems to work good with the correlation metric, which computes the correlation between vectors. Then minPts should be chosen. For this we will plot the silhouette score and the number of outliers the algorithm finds. We do not want too much outliers in the clustering.
# OPTICS algorithm
# Choosing minPts by plotting silhouette score and other metrics
min_samples_search = range(2,30)
silhouettes = []
outliers = []
reaches = []
Nclusters = []
for samp in min_samples_search:
Opt = OPTICS(min_samples=samp , metric='correlation') #
optics_mod = Opt.fit(X_clust_red)
labels = optics_mod.labels_
# Number of clusters
nb_clusters = optics_mod.cluster_hierarchy_.shape[0]
# Silhouette score
if nb_clusters > 1:
score = silhouette_score(X_clust, labels)
else: score = np.nan
# outliers
n_outliers = np.count_nonzero(labels == -1)
# sum of reachability distances
reach = optics_mod.reachability_
sum_r = np.sum(reach[np.isfinite(reach)])
silhouettes.append(score)
outliers.append(n_outliers)
reaches.append(sum_r)
Nclusters.append(nb_clusters)
# Plot clustering performance for OPTICS algorithm
fig = make_subplots(rows=2, cols=1, specs=[[{"secondary_y": True}], [{"secondary_y": False}]],
subplot_titles=('Clustering performances', 'Number of clusters'))
fig.add_trace(go.Scatter(x=list(min_samples_search), y=silhouettes, name="Silhouette score"), row=1, col=1, secondary_y=False)
fig.add_trace(go.Scatter(x=list(min_samples_search), y=outliers, name="Number of outliers"), row=1, col=1, secondary_y=True)
fig.add_trace(go.Scatter(x=list(min_samples_search), y=Nclusters, name="Number of clusters"), row=2, col=1, secondary_y=False)
fig.update_layout(xaxis1=dict(title='Minimum number of samples'),
xaxis2=dict(title='Minimum number of samples'),
yaxis1=dict(title='Silhouette score'),
yaxis2=dict(title='Number of outliers'),
yaxis3=dict(title='Number of clusters'))
fig.update_layout(height=900, width=1100, title='Results of OPTICS clustering',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/optics.html", 'w') as file:
file.write(html)
The silhouette score is not defined when the clustering results in 1 cluster, therefore the line is not defined in some parts. The clustering is not very good and yields in a lot of outliers. However, a minimum number of samples which yields good results is 19, which results in 2 clusters. Next we will explore clustering with Kmeans.
cluster_search = range(2,25)
silhouettes_k = []
SSE = []
for clust in cluster_search:
Km = KMeans(n_clusters=clust, random_state=10)
kmeans_mod = Km.fit(X_clust_red)
labels = kmeans_mod.labels_
# Silhouette score
score = silhouette_score(X_clust_red, labels)
# sum of squared errors
error = kmeans_mod.inertia_
silhouettes_k.append(score)
SSE.append(error)
# Plot clustering performance for KMeans algorithm
fig = make_subplots(specs=[[{"secondary_y": True}]])
fig.add_trace(go.Scatter(x=list(cluster_search), y=silhouettes_k, name="Silhouette score"), secondary_y=False)
fig.add_trace(go.Scatter(x=list(cluster_search), y=SSE, name="Sum of squared errors"), secondary_y=True)
fig.update_layout(xaxis=dict(title='Number of clusters'),
yaxis1=dict(title='Silhouette score'),
yaxis2=dict(title='Sum of squared errors'))
fig.update_layout(height=600, width=1100, title='Results of K-Means clustering',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/kmeans.html", 'w') as file:
file.write(html)
Here the clustering is a bit better. The best number of clusters seems to be 11. However, it still does not show very high silhouette scores, which means the data does not easily separate into clusters.
Next we will visualize our analyzed clusters using t-SNE.
# Cluster with the right algorithm and parameter
fin_labels = KMeans(n_clusters=11, random_state=10).fit_predict(X_clust_red)
X_viz_tsne = TSNE(n_components=2, perplexity=12).fit_transform(X_clust)
Viz_df = pd.DataFrame({'First dimension': X_viz_tsne[:,0], 'Second dimension': X_viz_tsne[:,1], 'Cluster label': map(str, fin_labels)})
# Plot the clusters found
fig = px.scatter(Viz_df, x="First dimension", y="Second dimension", color="Cluster label",
color_discrete_sequence=px.colors.qualitative.Vivid ) # change size
fig.update_layout(title='Visualizations of the clusters in 2 dimensions using t-SNE',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/tsne_features.html", 'w') as file:
file.write(html)
Now that we have clusters, we want to see how the years of the events in theses clusters are distributed. For this we will firstly analyze the mean of each cluster, and compute the 90% confidence interval of the year values in each cluster.
# Analyzing the periods of the clusters
X_clust['Cluster labels'] = fin_labels
year_clust['Cluster labels'] = fin_labels
Cluster_info = year_clust.groupby('Cluster labels').agg('mean')
Cluster_info = Cluster_info.join(year_clust.groupby('Cluster labels')[['year']].apply(CI, nbr_draws=10))
Cluster_info.sort_values('year', inplace=True)
Cluster_info.head()
| year | CI lower bound | CI higher bound | |
|---|---|---|---|
| Cluster labels | |||
| 3 | 1963.000000 | 1958.440000 | 1969.800000 |
| 0 | 1964.370370 | 1961.703704 | 1968.350000 |
| 4 | 1966.000000 | 1966.000000 | 1966.000000 |
| 5 | 1977.428571 | 1970.871429 | 1983.707143 |
| 2 | 1978.478261 | 1974.145652 | 1981.847826 |
Here is presented the time of the civil war onsets, grouped into the clusters found previously.
# Plotting the periods of the clusters
df_plot = year_clust.groupby('Cluster labels')
fig, ax = plt.subplots(figsize=(15,10))
sns.violinplot(x='year', y='Cluster labels', data=year_clust, order=list(Cluster_info.sort_values('year', ascending=False).index.values),
orient="h", scale='count', ax=ax)
fig.suptitle('Distribution of the civil war onsets clusters')
Text(0.5, 0.98, 'Distribution of the civil war onsets clusters')
We see on this plot, that the clusters actually range over quite some periods. For some clusters, they are quite narrow in the time range. This would indeed mean that we found some civil war onsets which had similar causes due to their period of onset. However, the clusters are not timely separated. This could be due to various things. Firstly, we found similar causes in the civil war onsets, and these causes could spread over a wide range of years, or these causes could have no relation with temporality. It could also be that the data is not easily clusterable, and the clusters found are not very reliable.
Next are the violin plots done with plotly.
fig = go.Figure()
fig.update_yaxes(type='category')
for clust in list(Cluster_info.sort_values('year', ascending=True).index.values):
fig.add_trace(go.Violin(x=year_clust['year'][year_clust['Cluster labels'] == clust],
y=year_clust['Cluster labels'][year_clust['Cluster labels'] == clust],
name="Cluster "+str(clust),
orientation='h',
scalemode='count'))
fig.update_layout(title='Distribution of the civil war onsets clusters')
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/violin.html", 'w') as file:
file.write(html)
print(list(map(str,list(Cluster_info.sort_values('year', ascending=False).index.values))))
['9', '8', '1', '10', '6', '7', '2', '5', '4', '0', '3']
In this part, we will firstly predict civil war ending using the 2 methods of interest, Random Forest and Neural Networks. The idea is to predict, during war, if the war will end this year. We will then study the predictive power of the two methods by plotting their ROC curves, along with the AUC score. This methods was also used by the authors. The ROC curve is useful in the context of class imbalance since we do not know the threshold for good classification a priori. This metric also gives a good idea of the robustness of the prediction. We will also perform dimensionality reduction on the activations of the last hidden layer of the MLP in order to get a better insight in how this type of model is able to learn non-linear mappings between features and prediction. This kind of approach would also be useful when using inputs of different modalities (visual, temporal). We will then look at the feature importances using permutation importance on a test set. Finally, we will plot some of these important variables on a world map for both values of the dependent variable.
# Train RF and MLP to predict civil war end and gather predictions and importances
rf_end,mlp_end,df_rf_end_predict,df_mlp_end_predict,importances_end = train_models('warend',df_end.drop(["cowalpha","statename"],axis=1),SEARCH_ITER,DATA_SPLIT,CV,SEED)
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 22.0s [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 1.1min finished
Fitting 5 folds for each of 20 candidates, totalling 100 fits
[Parallel(n_jobs=-1)]: Using backend LokyBackend with 4 concurrent workers. [Parallel(n_jobs=-1)]: Done 33 tasks | elapsed: 34.4s /home/matthieulc/.local/lib/python3.6/site-packages/joblib/externals/loky/process_executor.py:691: UserWarning: A worker stopped while some jobs were given to the executor. This can be caused by a too short worker timeout or by a memory leak. [Parallel(n_jobs=-1)]: Done 100 out of 100 | elapsed: 2.0min finished
Epoch 1/50 752/752 [==============================] - 0s 283us/step - loss: 5.1042 - accuracy: 0.3152 Epoch 2/50 752/752 [==============================] - 0s 5us/step - loss: 3.5776 - accuracy: 0.1356 Epoch 3/50 752/752 [==============================] - 0s 4us/step - loss: 2.9769 - accuracy: 0.1051 Epoch 4/50 752/752 [==============================] - 0s 4us/step - loss: 2.7410 - accuracy: 0.1051 Epoch 5/50 752/752 [==============================] - 0s 4us/step - loss: 2.6747 - accuracy: 0.1051 Epoch 6/50 752/752 [==============================] - 0s 5us/step - loss: 2.6571 - accuracy: 0.1051 Epoch 7/50 752/752 [==============================] - 0s 3us/step - loss: 2.6139 - accuracy: 0.1051 Epoch 8/50 752/752 [==============================] - 0s 4us/step - loss: 2.5287 - accuracy: 0.1051 Epoch 9/50 752/752 [==============================] - 0s 4us/step - loss: 2.4166 - accuracy: 0.1237 Epoch 10/50 752/752 [==============================] - 0s 4us/step - loss: 2.2970 - accuracy: 0.1423 Epoch 11/50 752/752 [==============================] - 0s 4us/step - loss: 2.1837 - accuracy: 0.1636 Epoch 12/50 752/752 [==============================] - 0s 5us/step - loss: 2.0924 - accuracy: 0.2035 Epoch 13/50 752/752 [==============================] - 0s 5us/step - loss: 2.0287 - accuracy: 0.2407 Epoch 14/50 752/752 [==============================] - 0s 6us/step - loss: 1.9819 - accuracy: 0.2726 Epoch 15/50 752/752 [==============================] - 0s 5us/step - loss: 1.9413 - accuracy: 0.3059 Epoch 16/50 752/752 [==============================] - 0s 4us/step - loss: 1.8959 - accuracy: 0.3311 Epoch 17/50 752/752 [==============================] - 0s 4us/step - loss: 1.8423 - accuracy: 0.3551 Epoch 18/50 752/752 [==============================] - 0s 4us/step - loss: 1.7824 - accuracy: 0.3697 Epoch 19/50 752/752 [==============================] - 0s 4us/step - loss: 1.7239 - accuracy: 0.3830 Epoch 20/50 752/752 [==============================] - 0s 4us/step - loss: 1.6711 - accuracy: 0.3976 Epoch 21/50 752/752 [==============================] - 0s 6us/step - loss: 1.6229 - accuracy: 0.4149 Epoch 22/50 752/752 [==============================] - 0s 4us/step - loss: 1.5807 - accuracy: 0.4229 Epoch 23/50 752/752 [==============================] - 0s 4us/step - loss: 1.5409 - accuracy: 0.4362 Epoch 24/50 752/752 [==============================] - 0s 4us/step - loss: 1.5010 - accuracy: 0.4588 Epoch 25/50 752/752 [==============================] - 0s 4us/step - loss: 1.4594 - accuracy: 0.4747 Epoch 26/50 752/752 [==============================] - 0s 4us/step - loss: 1.4167 - accuracy: 0.4920 Epoch 27/50 752/752 [==============================] - 0s 4us/step - loss: 1.3732 - accuracy: 0.5186 Epoch 28/50 752/752 [==============================] - 0s 4us/step - loss: 1.3319 - accuracy: 0.5426 Epoch 29/50 752/752 [==============================] - 0s 4us/step - loss: 1.2941 - accuracy: 0.5745 Epoch 30/50 752/752 [==============================] - 0s 8us/step - loss: 1.2587 - accuracy: 0.5918 Epoch 31/50 752/752 [==============================] - 0s 5us/step - loss: 1.2235 - accuracy: 0.6237 Epoch 32/50 752/752 [==============================] - 0s 5us/step - loss: 1.1877 - accuracy: 0.6423 Epoch 33/50 752/752 [==============================] - 0s 10us/step - loss: 1.1489 - accuracy: 0.6569 Epoch 34/50 752/752 [==============================] - 0s 4us/step - loss: 1.1100 - accuracy: 0.6622 Epoch 35/50 752/752 [==============================] - 0s 5us/step - loss: 1.0729 - accuracy: 0.6676 Epoch 36/50 752/752 [==============================] - 0s 4us/step - loss: 1.0378 - accuracy: 0.6822 Epoch 37/50 752/752 [==============================] - 0s 6us/step - loss: 1.0051 - accuracy: 0.6928 Epoch 38/50 752/752 [==============================] - 0s 4us/step - loss: 0.9733 - accuracy: 0.7008 Epoch 39/50 752/752 [==============================] - 0s 5us/step - loss: 0.9426 - accuracy: 0.7114 Epoch 40/50 752/752 [==============================] - 0s 4us/step - loss: 0.9135 - accuracy: 0.7194 Epoch 41/50 752/752 [==============================] - 0s 5us/step - loss: 0.8851 - accuracy: 0.7420 Epoch 42/50 752/752 [==============================] - 0s 6us/step - loss: 0.8557 - accuracy: 0.7620 Epoch 43/50 752/752 [==============================] - 0s 4us/step - loss: 0.8269 - accuracy: 0.7779 Epoch 44/50 752/752 [==============================] - 0s 6us/step - loss: 0.7994 - accuracy: 0.7912 Epoch 45/50 752/752 [==============================] - 0s 7us/step - loss: 0.7731 - accuracy: 0.7952 Epoch 46/50 752/752 [==============================] - 0s 4us/step - loss: 0.7476 - accuracy: 0.7965 Epoch 47/50 752/752 [==============================] - 0s 4us/step - loss: 0.7231 - accuracy: 0.8045 Epoch 48/50 752/752 [==============================] - 0s 4us/step - loss: 0.6990 - accuracy: 0.8138 Epoch 49/50 752/752 [==============================] - 0s 4us/step - loss: 0.6753 - accuracy: 0.8191 Epoch 50/50 752/752 [==============================] - 0s 3us/step - loss: 0.6526 - accuracy: 0.8298 448/448 [==============================] - 0s 578us/step 448/448 [==============================] - 0s 230us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 6us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 7us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 6us/step 448/448 [==============================] - 0s 10us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 7us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 7us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 7us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 8us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 7us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 6us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 7us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 12us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 6us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 7us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 6us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 6us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 9us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 12us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 2us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 5us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 4us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step 448/448 [==============================] - 0s 3us/step
fig = go.Figure()
fig.add_shape(
type='line', line=dict(dash='dash'),
x0=0, x1=1, y0=0, y1=1
)
# Generate ROC curve and thresholds
fpr_rf_end, tpr_rf_end, thr_rf_end = roc_curve(df_rf_end_predict.Label, df_rf_end_predict.Predicted)
fpr_mlp_end, tpr_mlp_end, thr_mlp_end = roc_curve(df_mlp_end_predict.Label, df_mlp_end_predict.Predicted)
# Calculate AUC
auc_rf_end = auc(fpr_rf_end, tpr_rf_end)
auc_mlp_end = auc(fpr_mlp_end, tpr_mlp_end)
# Plot
fig.add_trace(go.Scatter(x=fpr_rf_end, y=tpr_rf_end, name='Random Forest (AUC = %0.3f)'% auc_rf_end, mode='lines'))
fig.add_trace(go.Scatter(x=fpr_mlp_end, y=tpr_mlp_end, name='Multi Layer Perceptron (AUC = %0.3f)'% auc_mlp_end, mode='lines'))
fig.update_layout(
xaxis_title='False Positive Rate',
yaxis_title='True Positive Rate',
yaxis=dict(scaleanchor="x", scaleratio=1),
xaxis=dict(constrain='domain'),
width=700, height=500,
)
fig.update_layout(title='ROC curve for civil war end',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/roc_end.html", 'w') as file:
file.write(html)
The ROC curves yield good results for the RF approach, and rather poor results for the MLP (yet better than random). This result is probably due to the difficulty of MLP to manipulate class imbalance, even when some weightings are explicitly added in the lost function, like we did. Random Forests, on the other hand, are very powerful at doing so. In the context of this project, we also experimented with Autoencoders, which are good alternatives for dealing with class imbalance. Here, the "anomaly" (classical use of autoencoders) was the end of civil war. The ROC curve for different values of the reconstruction error threshold was actually better than for the MLP. However we did not wish to present the results here for one reason: interpreting feature importance, which is the goal of this project, is not straightforward since the model is trained only on negative examples and would have needed much more work to relate to causality (one idea was to use the features yielding the most reconstruction error for the positive case, the issue being that the features found were very different from the RF model). However this could be a nice extension to this project.
# Scale whole dataset
df_end_X = df_end.drop(['warend','cowalpha','statename'],axis=1)
scaler = StandardScaler().fit(df_end_X)
df_end_X = scaler.transform(df_end_X)
# Retrieve up to second-to-last layer of the trained MLP to generate the embeddings
mlp_end_enc = keras.models.Sequential([
mlp_end.model.layers[0],
mlp_end.model.layers[1],
mlp_end.model.layers[2]
])
# Clone the model with random weights for control
mlp_end_enc_u = keras.models.clone_model(mlp_end_enc)
# Perform dimensionality reduction with t-SNE on the features directly
tsne_f_end = TSNE(n_components=2,perplexity=30).fit_transform(df_end_X)
tx_f_end = tsne_f_end[:, 0]
ty_f_end = tsne_f_end[:, 1]
# Perform dimensionality reduction with t-SNE on the untrained embeddings/activations
tsne_ua_end = TSNE(n_components=2,perplexity=30).fit_transform(mlp_end_enc_u.predict(df_end_X))
tx_ua_end = tsne_ua_end[:, 0]
ty_ua_end = tsne_ua_end[:, 1]
# Perform dimensionality reduction with t-SNE on the trained embeddings/activations
tsne_a_end = TSNE(n_components=2,perplexity=30).fit_transform(mlp_end_enc.predict(df_end_X))
tx_a_end = tsne_a_end[:, 0]
ty_a_end = tsne_a_end[:, 1]
fig = make_subplots(rows=1, cols=3,
subplot_titles=("Features","Untrained activations", "Trained activations"))
# Generate the color labels
color_labels = ['mediumblue' if x is 1 else 'lightsalmon' for x in df_end['warend']]
# Add the feature plot
fig.add_trace(go.Scatter(x=tx_f_end,y=ty_f_end,mode='markers',marker_color=color_labels,showlegend=False),row=1, col=1)
# Add the untrained activations plot
fig.add_trace(
go.Scatter(x=tx_ua_end, y=ty_ua_end,mode='markers',marker_color=color_labels,showlegend=False),
row=1, col=2
)
# Add the trained activations plot
fig.add_trace(
go.Scatter(x=tx_a_end, y=ty_a_end,mode='markers',marker_color=color_labels,showlegend=False),
row=1, col=3
)
# Add color legends
fig.add_trace(go.Scatter(x=[None], y=[None], mode='markers',
marker_color='mediumblue',
legendgroup='Civil war end', showlegend=True, name='Civil war end'))
fig.add_trace(go.Scatter(x=[None], y=[None], mode='markers',
marker_color='lightsalmon',
legendgroup='Civil war', showlegend=True, name='Civil war'))
fig.update_layout(height=500, width=1200, title_text="Visualization of the datapoints using t-SNE for dimensionality reduction",title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/tsne_end.html", 'w') as file:
file.write(html)
Here are the activations of the last hidden layer of the MLP for the dataset. We also use two controls - the features and untrained activations - in order to put into perspective the results, as it is often with ANNs that even untrained networks can have well clustered activations due to the input distribution. Here we see that the trained MLP is able to group the civil war onset datapoints (bottom-right) better than the controls. Still we see that the cluster overlaps with some negative datapoints. This shows that the MLP is able to extract some mapping from the features in order to group somewhat separately the two events (civil war end and no end) to make a prediction.
# Plot feature importance for RF and MLP
fig = px.bar(importances_end, x="Names", y="Scores", color="Model", title="Permutation importance scores for civil war end")
fig.update_xaxes(tickangle=45)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/imp_end.html", 'w') as file:
file.write(html)
Here we see that even if the MLP has less predictive power, the feature importances are very similar. Similarly to civil war onset, economical factors are again very important. This last points needs to be put into perspective: the reason is that it is difficult, because of how the dataset is made (in bins of years), to know what is the order of causality here: is the ending of the war due to large numbers of primary commodity exports/GDP, boosting the economy and assuaging the minds leading to the end of the conflict, or are the good numbers following the end of the war, since the economy can now thrive again. We cannot know this from this dataset, but looking at smaller time bins (months) would help us in understanding the ending of conflicts better.
traces = []
buttons = []
# Add a map for the negative class
traces.append(go.Choropleth(
locations=df_end[df_end['warend']==0]['cowalpha'],
z=df_end[df_end['warend']==0]['sxpsq'].astype(float),
colorbar_title='Primary commodity exports/GDP (squared)',
visible= True,
hovertext=df_end[df_end['warend']==0]['statename']))
# Add a button for the negative class
buttons.append(dict(label='Civil war',
method="update",
args=[{"visible":[True,False]},
{"title":'Primary commodity exports/GDP during civil war (squared)'}]))
# Add a map for the positive class
traces.append(go.Choropleth(
locations=df_end[df_end['warend']==1]['cowalpha'],
z=df_end[df_end['warend']==1]['sxpsq'].astype(float),
colorbar_title='Primary commodity exports/GDP (squared)',
visible= False,
hovertext=df_end[df_end['warend']==1]['statename']))
# Add a button for the positive class
buttons.append(dict(label='Civil war end',
method="update",
args=[{"visible":[False,True]},
{"title":'Primary commodity exports/GDP upon civil war end (squared)'}]))
# Initialize
updatemenus = [{"active":0,
"buttons":buttons,
}]
# Show figure
fig = go.Figure(data=traces,
layout=dict(updatemenus=updatemenus))
fig.update_layout(title='Primary commodity exports/GDP during civil war (squared)',title_x=0)
fig.show()
html = plot(fig, auto_open=False, output_type='div')
with open("cwonset/_includes/map_gdp_end.html", 'w') as file:
file.write(html)
It is clear here that primary commodity exports/GDP are on the rise in years where the civil war stops. For instance, Mali shows an increase on average from 0.01 to 0.05 (5x increase). Is it due to the end of the civil war, or has this triggered the end of the civil war? Good question!